00000001:02000400:0.0F:1784584565.622288:0:2976:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1784584584.719446:0:3197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1784584586.481240:0:3260:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 616 MB/s 00000001:01000000:2.0:1784584586.731062:0:3260:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 703 MB/s 00000001:01000000:3.0F:1784584586.980766:0:3260:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7571 MB/s 00000020:02000000:3.0:1784584587.501138:0:3289:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_183_ga497ed6 00000400:02000000:3.0:1784584588.126383:0:3304:0:(api-ni.c:2766:lnet_startup_lndni()) Added LNI 192.168.203.152@tcp [8/256/0/180] 00008000:02000000:2.0:1784584591.219444:0:3454:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1784584637.459252:0:5258:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1784584645.797486:0:5786:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784584645.797498:0:5786:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1784584645.797618:0:5786:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000d6d17a79 00000080:02000400:1.0:1784584645.797629:0:5786:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1784584645.804490:0:5786:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1784584645.804504:0:5786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1784584645.804543:0:5786:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000050fa4d0b) 00000020:00000080:1.0:1784584645.804563:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784584645.829448:0:5786:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1784584645.832154:0:5786:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1784584645.868372:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784584645.868417:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784584645.868437:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784584645.868499:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784584645.868526:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784584645.870321:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784584645.870333:0:5786:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784584645.870346:0:5786:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff0c67 00000020:01000004:3.0:1784584645.870354:0:5786:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784584645.870358:0:5786:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784584645.870364:0:5786:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d6d17a79 from MGS 00000020:01000004:3.0:1784584645.870368:0:5786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784584645.870399:0:5786:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000004e907049) 00000020:00000080:3.0:1784584645.870417:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784584645.870500:0:5786:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d6d17a79 from MGS, refs=2 00080000:01000000:3.0:1784584645.870507:0:5786:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784584645.870512:0:5786:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff0c75 00000100:00100000:3.0:1784584645.870625:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784584645.870770:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784584645.870776:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1784584645.871571:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1784584645.871579:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1784584645.872501:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584645.872659:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1784584645.872684:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784584645.875625:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784584645.875643:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1784584645.879784:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784584645.879797:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784584645.880777:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584645.880782:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584645.880783:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584645.881228:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584645.881231:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584645.881232:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584645.881862:0:5786:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784584645.887958:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784584646.130887:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2783 MB/s 00000001:01000000:2.0:1784584646.381893:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3615 MB/s 00000001:01000000:2.0:1784584646.632254:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 687 MB/s 00000001:01000000:3.0:1784584646.882304:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 543 MB/s 00080000:10000000:2.0:1784584646.892553:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1784584646.939229:0:5786:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1784584646.939253:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784584646.939256:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1784584646.939840:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784584646.940639:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784584646.940748:0:5786:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784584646.940789:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784584646.941011:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784584646.941039:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1784584646.941404:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584646.941562:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1784584646.941573:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1784584646.943440:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784584646.943452:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784584646.944837:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784584646.944848:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1784584646.946240:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784584646.946262:0:5786:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:2.0:1784584646.946264:0:5786:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1784584646.946667:0:5802:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1784584646.946869:0:5786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:2.0:1784584646.946888:0:5786:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (00000000a3b370dd) 00000020:00000080:2.0:1784584646.946904:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784584646.947044:0:5786:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000281dc38e@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1784584646.947231:0:5786:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:2.0:1784584646.947239:0:5786:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 10000000:01000000:2.0:1784584646.950772:0:5803:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1784584646.951011:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid c4006421-7015-489e-aaaa-81e9219afdea) 00000020:00000080:2.0:1784584646.951045:0:5786:0:(genops.c:1406:class_connect()) connect: client c4006421-7015-489e-aaaa-81e9219afdea, cookie 0x787d778cc3ff0c83 00000100:00080000:2.0:1784584646.951057:0:5786:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584646.951063:0:5786:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import 00000000281dc38e using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1784584646.951106:0:5786:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d30172b9 x1871272568946816/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584646.951230:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d30172b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c4006421-7015-489e-aaaa-81e9219afdea:3319:1871272568946816:0@lo:250: 00000100:00100000:2.0:1784584646.951302:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784584646.951366:0:5786:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c4006421-7015-489e-aaaa-81e9219afdea->MGS 00000020:01000004:2.0:1784584646.951385:0:5786:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1784584646.951390:0:5786:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1784584646.951404:0:5786:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000002d74c293) 00000020:00000080:2.0:1784584646.951416:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1784584646.952726:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568946816 00000100:00100000:1.0:1784584646.952737:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568946816 00000100:00100000:1.0:1784584646.952771:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584646.952778:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac9b8b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3319:x1871272568946816:12345-0@lo:250: 00010000:00080000:1.0:1784584646.952801:0:5798:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from c4006421-7015-489e-aaaa-81e9219afdea@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:1.0:1784584646.952842:0:5798:0:(genops.c:1406:class_connect()) connect: client c4006421-7015-489e-aaaa-81e9219afdea, cookie 0x787d778cc3ff0c91 00000100:00080000:1.0:1784584646.952971:0:5798:0:(import.c:65:import_set_state_nolock()) 00000000330e5a02 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584646.953074:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac9b8b9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+5:3319:x1871272568946816:12345-0@lo:250: Request processed in 294us (1771us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584646.953082:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584646.953145:0:3319:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784584646.953155:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:2.0:1784584646.953162:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784584646.953167:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784584646.953170:0:3319:0:(import.c:65:import_set_state_nolock()) 00000000281dc38e MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784584646.953172:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784584646.953181:0:3319:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784584646.953186:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d30172b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c4006421-7015-489e-aaaa-81e9219afdea:3319:1871272568946816:0@lo:250: 00000100:00100000:2.0:1784584646.966625:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584646.966867:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1784584646.966874:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1784584646.968478:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1784584646.968488:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1784584646.971041:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1784584646.971055:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1784584646.972486:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584646.972905:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1784584646.972912:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1784584646.973446:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1784584646.973453:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1784584647.009015:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584647.009349:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1784584647.009356:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784584647.010688:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784584647.010848:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784584647.011685:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584647.012244:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784584647.012251:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784584647.012833:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784584647.013032:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1784584647.013837:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584647.014265:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784584647.014276:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1784584647.015282:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784584647.015292:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1784584647.017275:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584647.017501:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1784584647.017508:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1784584647.018366:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1784584647.018374:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784584647.048234:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584647.048444:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784584647.048452:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784584647.050358:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784584647.050370:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784584647.052275:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784584647.052297:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784584647.053368:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784584647.053391:0:5786:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784584647.053397:0:5786:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784584647.053539:0:5786:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784584647.053572:0:5786:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1784584647.053576:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784584647.053578:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784584647.053579:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584647.053581:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584647.053582:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584647.053583:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584647.053584:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784584647.053586:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784584647.053587:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784584647.053588:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784584647.053590:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584647.053591:0:5786:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584647.053598:0:5786:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1784584647.053600:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784584647.053601:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784584647.053602:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584647.053603:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584647.053604:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584647.053605:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584647.053606:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784584647.053607:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784584647.053608:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784584647.053608:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784584647.053609:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584647.053610:0:5786:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584647.053650:0:5786:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784584647.053678:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000080192d7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568946944:0@lo:253: 00000100:00100000:3.0:1784584647.054310:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584647.054410:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000002230f51e going to sleep for 11 seconds 00000100:00100000:1.0:1784584647.054505:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568946944 00000100:00100000:1.0:1784584647.054522:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568946944 00000100:00100000:1.0:1784584647.054616:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784584647.054625:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d95b5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+5:5786:x1871272568946944:12345-0@lo:253: 20000000:01000000:1.0:1784584647.054682:0:5800:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784584647.054685:0:5800:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1784584647.055265:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1784584647.055342:0:5800:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1784584647.055647:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584647.056809:0:5823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1784584647.057346:0:5800:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784584647.057350:0:5800:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1784584647.057355:0:5800:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1784584647.057359:0:5800:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1784584647.057375:0:5800:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1784584647.057625:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584647.058401:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1784584647.058420:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784584647.058497:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1784584647.058549:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1784584647.058589:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1784584647.058722:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1784584647.058731:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1784584647.058779:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1784584647.058788:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1784584647.058820:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1784584647.058834:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1784584647.058868:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1784584647.058927:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1784584647.059309:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784584647.059316:0:5800:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1784584647.059332:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584647.059531:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1784584647.059542:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784584647.059575:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1784584647.059603:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1784584647.059648:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1784584647.059659:0:5800:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1784584647.059825:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1784584647.059834:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1784584647.059870:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1784584647.060009:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1784584647.060043:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1784584647.060171:0:5800:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1784584647.060264:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1784584647.060273:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1784584647.060305:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1784584647.060342:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1784584647.060509:0:5800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1784584647.060556:0:5800:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1784584647.060564:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1784584647.062514:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1784584647.063235:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1784584647.063260:0:5800:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.152@tcp for mdt 20000000:01000000:2.0:1784584647.063263:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:2.0:1784584647.063298:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1784584647.063305:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784584647.063332:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1784584647.063338:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:2.0:1784584647.063386:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1784584647.063395:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1784584647.063421:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1784584647.063472:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1784584647.063535:0:5800:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784584647.063538:0:5800:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1784584647.063543:0:5800:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1784584647.063549:0:5800:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1784584647.064024:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1784584647.064252:0:5800:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1784584647.074988:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1784584647.075043:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:2.0:1784584647.075139:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:2.0:1784584647.075159:0:5800:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784584647.075162:0:5800:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784584647.075166:0:5800:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784584647.075191:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784584647.075194:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784584647.075223:0:5800:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784584647.075225:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784584647.076240:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1784584647.076630:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1784584647.076681:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1784584647.076853:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1784584647.076867:0:5800:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1784584647.076869:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784584647.077383:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1784584647.077590:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1784584647.077647:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1784584647.077942:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1784584647.077960:0:5800:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784584647.077962:0:5800:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1784584647.077969:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1784584647.077988:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078004:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078014:0:5800:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078019:0:5800:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078025:0:5800:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078031:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078045:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044f42f18 already unused, calling callback (00000000e828231e) 00010000:00010000:1.0:1784584647.078048:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078056:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078067:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078074:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.078079:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044f42f18/0x787d778cc3ff0c98 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784584647.078093:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784584647.334914:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d95b5fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+5:5786:x1871272568946944:12345-0@lo:253: Request processed in 280283us (280599us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.334933:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584647.335278:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000080192d7f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568946944:0@lo:253: 10000000:01000000:0.0:1784584647.335295:0:5786:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784584647.335299:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784584647.335301:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784584647.335302:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584647.335303:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1784584647.335304:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584647.335305:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584647.335306:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784584647.335308:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784584647.335309:0:5786:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784584647.335311:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584647.335312:0:5786:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784584647.335333:0:5786:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000d6d17a79 from lustre-MDT0000 10000000:01000000:0.0:1784584647.335358:0:5786:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1784584647.335361:0:5786:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784584647.335365:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97c7c5d4b380 10000000:01000000:0.0:1784584647.335369:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784584647.335376:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97c7c5d4b380 from 1 10000000:01000000:0.0:1784584647.335380:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784584647.335435:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000053649b3/0x787d778cc3ff0c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584647.335445:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000053649b3/0x787d778cc3ff0c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584647.335478:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000053649b3/0x787d778cc3ff0c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584647.335497:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000909d4a9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947072:0@lo:101: 00000100:00100000:0.0:1784584647.335552:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584647.335617:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a95c0a5a going to sleep for 11 seconds 00000100:00100000:3.0:1784584647.335689:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568947072 00000100:00100000:3.0:1784584647.335725:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568947072 00000100:00100000:3.0:1784584647.335768:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584647.335776:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011b4807d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+5:5786:x1871272568947072:12345-0@lo:101: 00010000:00010000:3.0:1784584647.335796:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584647.335809:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ee0e9bc/0x787d778cc3ff0ca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0c9f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.335832:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ee0e9bc/0x787d778cc3ff0ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0c9f expref: 6 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.335842:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ee0e9bc/0x787d778cc3ff0ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0c9f expref: 6 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.335850:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ee0e9bc, rc 0) 00000100:00100000:3.0:1784584647.335879:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011b4807d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+6:5786:x1871272568947072:12345-0@lo:101: Request processed in 104us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.335886:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584647.335959:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000909d4a9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947072:0@lo:101: 00010000:00010000:0.0:1784584647.335972:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000053649b3/0x787d778cc3ff0c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584647.335980:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000053649b3/0x787d778cc3ff0c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584647.336023:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000909d4a9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947200:0@lo:501: 00000100:00100000:0.0:1784584647.336048:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584647.336071:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a95c0a5a going to sleep for 11 seconds 00000100:00100000:3.0:1784584647.336122:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568947200 00000100:00100000:3.0:1784584647.336127:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568947200 00000100:00100000:3.0:1784584647.336154:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584647.336160:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000106ba6cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+6:5786:x1871272568947200:12345-0@lo:501: 00000100:00100000:3.0:1784584647.336415:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000106ba6cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+6:5786:x1871272568947200:12345-0@lo:501: Request processed in 255us (366us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784584647.336423:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584647.339893:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000909d4a9b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947200:0@lo:501: 10000000:01000000:1.0:1784584647.339969:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784584647.340093:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000053649b3/0x787d778cc3ff0c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.340103:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000053649b3/0x787d778cc3ff0c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584647.340122:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c7d687f000 10000000:01000000:1.0:1784584647.340130:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784584647.340142:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97c7d687f000 10000000:01000000:1.0:1784584647.340144:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784584647.340148:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97c7d687f000 from 1 10000000:01000000:1.0:1784584647.340165:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784584647.340220:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000044f42f18/0x787d778cc3ff0cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.340229:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000044f42f18/0x787d778cc3ff0cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.340238:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000044f42f18/0x787d778cc3ff0cad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584647.340258:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cfa1e236 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947328:0@lo:101: 00000100:00100000:1.0:1784584647.340324:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584647.340374:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 0000000081a460a7 going to sleep for 11 seconds 00000100:00100000:3.0:1784584647.340506:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568947328 00000100:00100000:3.0:1784584647.340514:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568947328 00000100:00100000:3.0:1784584647.340566:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784584647.340574:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c67bf217 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+6:5786:x1871272568947328:12345-0@lo:101: 00010000:00010000:3.0:1784584647.340586:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584647.340598:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003de0c2f1/0x787d778cc3ff0cb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0cad expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.340630:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003de0c2f1/0x787d778cc3ff0cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0cad expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.340640:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003de0c2f1/0x787d778cc3ff0cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0cad expref: 7 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.340648:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003de0c2f1, rc 0) 00000100:00100000:3.0:1784584647.340688:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c67bf217 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+7:5786:x1871272568947328:12345-0@lo:101: Request processed in 115us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.340715:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584647.340802:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cfa1e236 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947328:0@lo:101: 00010000:00010000:0.0:1784584647.340816:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000044f42f18/0x787d778cc3ff0cad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584647.340824:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000044f42f18/0x787d778cc3ff0cad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584647.340838:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784584647.343552:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000044f42f18/0x787d778cc3ff0cad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584647.343594:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000044f42f18/0x787d778cc3ff0cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584647.343604:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784584647.343645:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584647.343654:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97c7d687f000 10000000:01000000:1.0:1784584647.343657:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784584647.343661:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784584647.343664:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784584647.343724:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000037e08913/0x787d778cc3ff0cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.343732:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000037e08913/0x787d778cc3ff0cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.343743:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000037e08913/0x787d778cc3ff0cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584647.343768:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947456:0@lo:101: 00000100:00100000:1.0:1784584647.343851:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584647.343899:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568947456 00000100:00100000:1.0:1784584647.343904:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f1f7223 going to sleep for 11 seconds 00000100:00100000:3.0:1784584647.343908:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568947456 00000100:00100000:3.0:1784584647.343953:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584647.343960:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e32c19b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+7:5786:x1871272568947456:12345-0@lo:101: 00010000:00010000:3.0:1784584647.343973:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584647.343984:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2cbb73c/0x787d778cc3ff0cc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0cbb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.344006:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2cbb73c/0x787d778cc3ff0cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0cbb expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.344015:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2cbb73c/0x787d778cc3ff0cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0cbb expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.344023:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2cbb73c, rc 0) 00000100:00100000:3.0:1784584647.344068:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e32c19b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+8:5786:x1871272568947456:12345-0@lo:101: Request processed in 108us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.344075:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584647.344148:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947456:0@lo:101: 00010000:00010000:1.0:1784584647.344170:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000037e08913/0x787d778cc3ff0cbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.344177:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000037e08913/0x787d778cc3ff0cbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584647.344234:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947584:0@lo:501: 00000100:00100000:1.0:1784584647.344259:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584647.344282:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f1f7223 going to sleep for 11 seconds 00000100:00100000:0.0:1784584647.344770:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568947584 00000100:00100000:0.0:1784584647.344777:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568947584 00000100:00100000:0.0:1784584647.344893:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584647.344901:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b447b971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+8:5786:x1871272568947584:12345-0@lo:501: 00000100:00100000:0.0:1784584647.345633:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b447b971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+9:5786:x1871272568947584:12345-0@lo:501: Request processed in 731us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584647.345642:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584647.345786:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947584:0@lo:501: 00000100:00100000:1.0:1784584647.346082:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947712:0@lo:503: 00000100:00100000:1.0:1784584647.346343:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584647.346433:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000002f1f7223 going to sleep for 11 seconds 00000100:00100000:2.0:1784584647.346474:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568947712 00000100:00100000:2.0:1784584647.346480:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568947712 00000100:00100000:2.0:1784584647.346591:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584647.346598:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008738789e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+9:5786:x1871272568947712:12345-0@lo:503: 00000100:00100000:1.0:1784584647.346909:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568947712:0@lo:503: 00000100:00100000:2.0:1784584647.347389:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008738789e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+9:5786:x1871272568947712:12345-0@lo:503: Request processed in 203us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584647.347400:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784584647.349076:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c198e886 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:5829:1871272568947840:0@lo:502: 00000100:00100000:0.0:1784584647.349378:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584647.349571:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568947840 00000100:00100000:3.0:1784584647.349579:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568947840 00000100:00100000:3.0:1784584647.349634:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584647.349643:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f94979e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+9:5829:x1871272568947840:12345-0@lo:502: 00000100:00100000:0.0:1784584647.349897:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set 000000006e83d9b6 going to sleep for 11 seconds 00000100:00100000:3.0:1784584647.350783:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f94979e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+9:5829:x1871272568947840:12345-0@lo:502: Request processed in 1137us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.350794:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584647.350920:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c198e886 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:5829:1871272568947840:0@lo:502: 00000020:01000000:0.0:1784584647.351538:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584647.351552:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584647.351554:0:5829:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784584647.351559:0:5829:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784584647.351563:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584647.351588:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000b811f3a) 00000020:00000080:0.0:1784584647.351610:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784584647.351617:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784584647.352336:0:5829:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1784584647.352424:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff0cd0 00000020:00000080:2.0:1784584647.352719:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1784584647.352728:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584647.352733:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584647.352734:0:5829:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1784584647.352737:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584647.352742:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584647.352743:0:5829:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1784584647.352746:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784584647.352754:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000046b1f93a) 00000020:00000080:2.0:1784584647.352768:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1784584647.352773:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1784584647.352774:0:5829:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1784584647.352777:0:5829:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1784584647.352783:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784584647.353530:0:5829:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d6d17a79 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1784584647.353546:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004dd5b3a9) 00000020:00000080:2.0:1784584647.353557:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1784584647.353617:0:5829:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1784584647.353626:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff0ce5 00000020:00000080:2.0:1784584647.354346:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1784584647.354355:0:5829:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1784584647.354363:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x787d778cc3ff0cec 00080000:01000000:2.0:1784584647.354369:0:5829:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1784584647.354374:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff0cf3 00080000:10000000:2.0:1784584647.355107:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1784584647.355366:0:5829:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1784584647.360349:0:5829:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1784584647.459891:0:5829:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1784584647.460658:0:5829:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1784584647.464421:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1784584647.464976:0:5829:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1784584647.523612:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000894562fc) 00000020:00000080:2.0:1784584647.523636:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1784584647.523779:0:5829:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1784584647.523786:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff0d01 00000020:00000080:2.0:1784584647.530752:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1784584647.536477:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584647.612022:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784584647.657670:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584647.710136:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584647.743113:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1784584647.784437:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1784584647.824618:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x787d778cc3ff0d08 00000020:00000080:1.0:1784584647.825150:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784584647.825160:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584647.825167:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584647.825169:0:5829:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784584647.825172:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584647.825177:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584647.825178:0:5829:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784584647.825182:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784584647.825216:0:5829:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784584647.825230:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584647.825233:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584647.825234:0:5829:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784584647.825236:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584647.825245:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584647.825246:0:5829:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784584647.825250:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784584647.825252:0:5829:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784584647.825497:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:5829:1871272568947968:0@lo:502: 00000100:00100000:1.0:1784584647.825576:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584647.825712:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568947968 00000100:00100000:3.0:1784584647.825719:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568947968 00000100:00100000:3.0:1784584647.825755:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784584647.825762:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ae17d49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+9:5829:x1871272568947968:12345-0@lo:502: 00000100:00100000:3.0:1784584647.826045:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ae17d49 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+9:5829:x1871272568947968:12345-0@lo:502: Request processed in 283us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.826053:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584647.826135:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab89cba2 going to sleep for 11 seconds 00000100:00100000:1.0:1784584647.826157:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:5829:1871272568947968:0@lo:502: 00000020:01000000:1.0:1784584647.826183:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584647.826189:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584647.826190:0:5829:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784584647.826194:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1784584647.826554:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1784584647.826575:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784584647.826595:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000037e08913/0x787d778cc3ff0cbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.826605:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000037e08913/0x787d778cc3ff0cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584647.826623:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97c7d687f000 from 1 10000000:01000000:3.0:1784584647.826626:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784584647.826653:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.826661:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.826669:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584647.826684:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004099de70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948096:0@lo:101: 00000100:00100000:3.0:1784584647.826743:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584647.826861:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568948096 00000100:00100000:2.0:1784584647.826867:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568948096 00000100:00100000:2.0:1784584647.826897:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584647.826902:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004785626d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+9:5786:x1871272568948096:12345-0@lo:101: 00010000:00010000:2.0:1784584647.826912:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584647.826923:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0d0f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584647.826943:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0d0f expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584647.826952:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d0f expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584647.826960:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bae997c6, rc 0) 00000100:00100000:2.0:1784584647.826999:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004785626d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+10:5786:x1871272568948096:12345-0@lo:101: Request processed in 97us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584647.827005:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584647.827172:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000008df058f1 going to sleep for 11 seconds 00000100:00100000:3.0:1784584647.827190:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004099de70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948096:0@lo:101: 00010000:00010000:3.0:1784584647.827204:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.827212:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584647.827968:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004099de70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948224:0@lo:256: 00000100:00100000:3.0:1784584647.828462:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584647.828537:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000008df058f1 going to sleep for 11 seconds 00000100:00100000:2.0:1784584647.828577:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568948224 00000100:00100000:2.0:1784584647.828584:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568948224 00000100:00100000:2.0:1784584647.828667:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584647.828675:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e6b9a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+10:5786:x1871272568948224:12345-0@lo:256: 20000000:01000000:2.0:1784584647.828722:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784584647.828728:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784584647.828806:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e6b9a20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+10:5786:x1871272568948224:12345-0@lo:256: Request processed in 132us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584647.828814:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784584647.828911:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004099de70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948224:0@lo:256: 10000000:01000000:1.0:1784584647.830652:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584647.830753:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.830766:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584647.830775:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7d687f000 from 1 10000000:01000000:1.0:1784584647.830778:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584647.830816:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.830823:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.830832:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584647.830866:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948352:0@lo:101: 00000100:00100000:1.0:1784584647.830923:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584647.830977:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab89cba2 going to sleep for 11 seconds 00000100:00100000:3.0:1784584647.831066:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568948352 00000100:00100000:3.0:1784584647.831073:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568948352 00000100:00100000:3.0:1784584647.831111:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584647.831118:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a31be62a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+10:5786:x1871272568948352:12345-0@lo:101: 00010000:00010000:3.0:1784584647.831135:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584647.831148:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0d1d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.831168:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0d1d expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.831178:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d1d expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.831185:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004607e0f1, rc 0) 00000100:00100000:3.0:1784584647.831230:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a31be62a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+11:5786:x1871272568948352:12345-0@lo:101: Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.831237:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784584647.831594:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948352:0@lo:101: 00010000:00010000:1.0:1784584647.831608:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584647.831616:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584647.831664:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948480:0@lo:501: 00000100:00100000:1.0:1784584647.831713:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584647.831735:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab89cba2 going to sleep for 11 seconds 00000100:00100000:0.0:1784584647.832051:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568948480 00000100:00100000:0.0:1784584647.832057:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568948480 00000100:00100000:0.0:1784584647.832090:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584647.832096:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c815412 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+11:5786:x1871272568948480:12345-0@lo:501: 00000100:00100000:0.0:1784584647.833003:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c815412 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+11:5786:x1871272568948480:12345-0@lo:501: Request processed in 905us (1311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584647.833013:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784584647.833030:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948480:0@lo:501: 00000100:00100000:1.0:1784584647.833068:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948608:0@lo:503: 00000100:00100000:1.0:1784584647.833114:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584647.833150:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab89cba2 going to sleep for 11 seconds 00000100:00100000:3.0:1784584647.833208:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568948608 00000100:00100000:3.0:1784584647.833214:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568948608 00000100:00100000:3.0:1784584647.833248:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584647.833255:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081c904f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+11:5786:x1871272568948608:12345-0@lo:503: 00000040:00080000:3.0:1784584647.833309:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784584647.833361:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081c904f2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+11:5786:x1871272568948608:12345-0@lo:503: Request processed in 106us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.833367:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584647.833647:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000003fec039 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948608:0@lo:503: 00000040:00080000:1.0:1784584647.834738:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1784584647.834923:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1784584647.834941:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584647.834958:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584647.834968:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584647.835014:0:5786:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784584647.835018:0:5786:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c7d687f000 10000000:01000000:2.0:1784584647.835021:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c7d687f000 10000000:01000000:2.0:1784584647.835024:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784584647.835029:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7d687f000 from 1 10000000:01000000:2.0:1784584647.835032:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784584647.835062:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 000000006d372778/0x787d778cc3ff0d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584647.835070:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 000000006d372778/0x787d778cc3ff0d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584647.835092:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 000000006d372778/0x787d778cc3ff0d2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584647.835112:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d30172b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948736:0@lo:101: 00000100:00100000:2.0:1784584647.835166:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584647.835206:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000005c217490 going to sleep for 11 seconds 00000100:00100000:0.0:1784584647.835213:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568948736 00000100:00100000:0.0:1784584647.835220:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568948736 00000100:00100000:0.0:1784584647.835269:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784584647.835277:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1944991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+11:5786:x1871272568948736:12345-0@lo:101: 00010000:00010000:0.0:1784584647.835288:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584647.835308:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000049ed5bb1/0x787d778cc3ff0d32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0d2b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584647.835329:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000049ed5bb1/0x787d778cc3ff0d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0d2b expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584647.835338:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000049ed5bb1/0x787d778cc3ff0d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d2b expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584647.835345:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000049ed5bb1, rc 0) 00000100:00100000:0.0:1784584647.835387:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1944991 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:5786:x1871272568948736:12345-0@lo:101: Request processed in 111us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584647.835392:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584647.835532:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d30172b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948736:0@lo:101: 00010000:00010000:2.0:1784584647.835545:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 000000006d372778/0x787d778cc3ff0d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584647.835554:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 000000006d372778/0x787d778cc3ff0d2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584647.835599:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d30172b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948864:0@lo:501: 00000100:00100000:2.0:1784584647.835625:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584647.835645:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000005c217490 going to sleep for 11 seconds 00000100:00100000:1.0:1784584647.835686:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568948864 00000100:00100000:1.0:1784584647.835802:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568948864 00000100:00100000:1.0:1784584647.835832:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784584647.835838:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdd15688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:5786:x1871272568948864:12345-0@lo:501: 00000100:00100000:1.0:1784584647.836165:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdd15688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:5786:x1871272568948864:12345-0@lo:501: Request processed in 327us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584647.836172:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584647.837748:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d30172b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948864:0@lo:501: 00000100:00100000:0.0:1784584647.837917:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c198e886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948992:0@lo:503: 00000100:00100000:0.0:1784584647.837990:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584647.838042:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 0000000081445207 going to sleep for 11 seconds 00000100:00100000:3.0:1784584647.838111:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568948992 00000100:00100000:3.0:1784584647.838118:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568948992 00000100:00100000:3.0:1784584647.838179:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584647.838186:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000716e3b02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:5786:x1871272568948992:12345-0@lo:503: 00000100:00100000:3.0:1784584647.838934:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000716e3b02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:5786:x1871272568948992:12345-0@lo:503: Request processed in 746us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.838952:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584647.839026:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c198e886 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568948992:0@lo:503: 00000100:00100000:1.0:1784584647.839529:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3a94e1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:5834:1871272568949120:0@lo:502: 00000100:00100000:1.0:1784584647.839575:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584647.839610:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set 00000000dc8f9d2c going to sleep for 11 seconds 00000100:00100000:0.0:1784584647.839651:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568949120 00000100:00100000:0.0:1784584647.839656:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568949120 00000100:00100000:0.0:1784584647.839722:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784584647.839729:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084e405ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:5834:x1871272568949120:12345-0@lo:502: 00000100:00100000:0.0:1784584647.839944:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084e405ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:5834:x1871272568949120:12345-0@lo:502: Request processed in 216us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584647.839951:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784584647.840119:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3a94e1a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:5834:1871272568949120:0@lo:502: 00000020:01000004:1.0:1784584647.840173:0:5834:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784584647.840187:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ec818d37) 00000020:00000080:1.0:1784584647.840204:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1784584647.840433:0:5834:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000d6d17a79 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784584647.840437:0:5834:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000d6d17a79 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784584647.840440:0:5834:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000d6d17a79 4 00010000:00080000:1.0:1784584647.840474:0:5834:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e5a96d38@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1784584647.845836:0:5834:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1784584647.845939:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784584647.845993:0:5834:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784584647.846008:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x787d778cc3ff0d40 00000100:00080000:0.0:1784584647.846018:0:5834:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584647.846023:0:5834:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e5a96d38 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1784584647.846055:0:5834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000262d9e1 x1871272568949248/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584647.846084:0:5834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784584647.846220:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000262d9e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272568949248:0@lo:38: 00000100:00100000:2.0:1784584647.846365:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584647.846724:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568949248 00000100:00100000:0.0:1784584647.846731:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568949248 00000100:00100000:0.0:1784584647.846769:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584647.846777:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f124815 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1871272568949248:12345-0@lo:38: 00000100:00100000:0.0:1784584647.846834:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f124815 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1871272568949248:12345-0@lo:38: Request processed in 56us (470us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784584647.846842:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584647.847323:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584647.847332:0:3319:0:(import.c:65:import_set_state_nolock()) 00000000e5a96d38 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584647.847338:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1784584647.847343:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000262d9e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272568949248:0@lo:38: 00000100:00100000:0.0:1784584647.847416:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004345b49c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:5834:1871272568949376:0@lo:502: 00000100:00100000:0.0:1784584647.847482:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584647.847517:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b9768e2e going to sleep for 11 seconds 00000100:00100000:2.0:1784584647.847623:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568949376 00000100:00100000:2.0:1784584647.847629:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568949376 00000100:00100000:2.0:1784584647.847678:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584647.847685:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000702ade0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:5834:x1871272568949376:12345-0@lo:502: 00000100:00100000:2.0:1784584647.848112:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000702ade0a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:5834:x1871272568949376:12345-0@lo:502: Request processed in 426us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584647.848120:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784584647.848276:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004345b49c pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:5834:1871272568949376:0@lo:502: 00000040:00080000:0.0:1784584647.848310:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1784584647.848771:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1784584647.848792:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784584647.848810:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 000000006d372778/0x787d778cc3ff0d2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584647.848821:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 000000006d372778/0x787d778cc3ff0d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784584647.848864:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784584647.848867:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584647.848868:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584647.848869:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584647.848870:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584647.848871:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584647.848872:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584647.848874:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584647.848875:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784584647.848877:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784584647.848878:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584647.848880:0:5786:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584647.848883:0:5786:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1784584647.848885:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784584647.848887:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584647.848888:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584647.848889:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584647.848890:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584647.848890:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584647.848891:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584647.848892:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584647.848893:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784584647.848899:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784584647.848900:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584647.848901:0:5786:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584647.848919:0:5786:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784584647.848932:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f0fadf8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568949504:0@lo:253: 00000100:00100000:2.0:1784584647.848978:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584647.849004:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000004255ce41 going to sleep for 11 seconds 00000100:00100000:0.0:1784584647.849372:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568949504 00000100:00100000:0.0:1784584647.849379:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568949504 00000100:00100000:0.0:1784584647.849473:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784584647.849481:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e3fc981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:5786:x1871272568949504:12345-0@lo:253: 20000000:01000000:0.0:1784584647.849503:0:5798:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784584647.849516:0:5798:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784584647.940101:0:5798:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784584647.940189:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784584647.940251:0:5822:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784584647.940256:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784584647.940275:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.940294:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d0f expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.940301:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.940340:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0d0f expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.940353:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0d0f expref: 12 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584647.940366:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000dd9e992 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5822:1871272568949632:0@lo:104: 00000100:00100000:3.0:1784584647.940427:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584647.940495:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set 00000000398e4876 going to sleep for 11 seconds 00000100:00100000:0.0:1784584647.940774:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568949632 00000100:00100000:0.0:1784584647.940782:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568949632 00000100:00100000:0.0:1784584647.940829:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584647.940837:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edd4c9ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:5822:x1871272568949632:12345-0@lo:104: 00010000:00010000:0.0:1784584647.940848:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584647.940894:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584647.940898:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edd4c9ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:5822:x1871272568949632:12345-0@lo:104: Request processed in 63us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584647.940904:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784584647.941446:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584647.941462:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.941470:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fcba4d9b already unused, calling callback (000000008a27fa8f) 10000000:00010000:3.0:1784584647.941473:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.941481:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584647.941501:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584647.941507:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784584647.941549:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.941556:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584647.941575:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.941583:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 00000000fcba4d9b/0x787d778cc3ff0d0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d16 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.941600:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584647.941602:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584647.941604:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584647.941885:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002b9ef517 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568949760:0@lo:103: 00000100:00100000:3.0:1784584647.941927:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584647.942016:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568949760 00000100:00100000:3.0:1784584647.942021:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568949760 00010000:00010000:3.0:1784584647.942041:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d0f expref: 13 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584647.942065:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584647.942072:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003db9ec98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+13:3321:x1871272568949760:12345-0@lo:103: 00010000:00010000:3.0:1784584647.942082:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584647.942085:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d0f expref: 13 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942102:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0d0f expref: 13 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942497:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942508:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784584647.942523:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002266972s 00010000:00010000:3.0:1784584647.942526:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942532:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942538:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942544:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942550:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1dbb6a2 already unused, calling callback (00000000e828231e) 00010000:00010000:3.0:1784584647.942553:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942560:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942568:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942589:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584647.942634:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003db9ec98 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+13:3321:x1871272568949760:12345-0@lo:103: Request processed in 563us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.942642:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784584647.942683:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bae997c6/0x787d778cc3ff0d16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0d0f expref: 12 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584647.942716:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000dd9e992 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5822:1871272568949632:0@lo:104: 00010000:00010000:3.0:1784584647.942733:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942741:0:5822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942746:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584647.942751:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d47 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584647.943446:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002b9ef517 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568949760:0@lo:103: 00000100:00100000:3.0:1784584647.949911:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e3fc981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+11:5786:x1871272568949504:12345-0@lo:253: Request processed in 100421us (100924us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584647.949928:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784584647.950077:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f0fadf8a pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:5786:1871272568949504:0@lo:253: 10000000:01000000:0.0:1784584647.950093:0:5786:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1784584647.950096:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784584647.950098:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784584647.950099:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584647.950100:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784584647.950101:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584647.950103:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584647.950104:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784584647.950105:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784584647.950180:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784584647.950181:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784584647.950183:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584647.950184:0:5786:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784584647.950198:0:5786:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784584647.956475:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1784584647.956960:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784584647.958670:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1784584647.958900:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784584647.959309:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1784584647.959495:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1784584647.960864:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1784584647.961193:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1784584647.961659:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1784584647.961915:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1784584647.962410:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1784584647.962598:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:0.0:1784584647.969775:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1784584648.013062:0:5786:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1784584648.042917:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1784584648.043346:0:5840:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1784584648.046642:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784584648.046866:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:1.0:1784584648.047494:0:5839:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1784584648.047499:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:2.0:1784584648.047648:0:5786:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784584648.047657:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784584648.047883:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584648.049323:0:5786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784584648.049897:0:5786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784584648.049929:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1784584648.050420:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1784584648.050645:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1784584648.052803:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1784584648.052972:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1784584648.053349:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1784584648.053512:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1784584648.053655:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1784584648.053834:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1784584648.057397:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1784584648.057735:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1784584648.057881:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1784584648.062953:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1784584648.063297:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1784584648.063445:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1784584648.063620:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1784584648.063796:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1784584648.063960:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1784584648.064349:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1784584648.064658:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1784584648.064882:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1784584648.067715:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1784584648.067920:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1784584648.068056:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1784584648.068211:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1784584648.068361:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1784584648.068664:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1784584648.068829:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1784584648.068986:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1784584648.069344:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1784584648.069534:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1784584648.069677:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1784584648.069845:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1784584648.070074:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1784584648.070313:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1784584648.070517:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1784584648.087785:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1784584648.133856:0:5786:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1784584648.133894:0:5786:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb02341cab988 00100000:10000000:2.0:1784584648.133902:0:5786:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1784584648.134392:0:5786:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784584648.134408:0:5786:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784584648.134423:0:5786:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1784584648.134439:0:5786:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1784584648.142902:0:5840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784584648.145060:0:5840:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784584648.145068:0:5840:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1784584648.995140:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584650.015866:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584651.037473:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584652.062140:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784584652.797366:0:6082:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784584653.084896:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784584653.340567:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1784584653.340575:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784584653.340577:0:38:0:(import.c:65:import_set_state_nolock()) 00000000e5a96d38 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584653.340590:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000e5a96d38 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1784584653.340611:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000c9764e3 x1871272568950016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584653.340732:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000c9764e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272568950016:0@lo:38: 00000100:00100000:0.0:1784584653.340821:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584653.340899:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568950016 00000100:00100000:0.0:1784584653.340906:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568950016 00000100:00100000:0.0:1784584653.340935:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584653.340946:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eda7cda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1871272568950016:12345-0@lo:38: 00010000:00080000:0.0:1784584653.340969:0:5808:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000100:00100000:1.0:1784584653.341324:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004345b49c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568949888:0@lo:400: 00000100:00100000:1.0:1784584653.341365:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584653.341464:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568949888 00000100:00100000:1.0:1784584653.341468:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568949888 00000100:00100000:1.0:1784584653.341506:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784584653.341511:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065391551 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+11:3322:x1871272568949888:12345-0@lo:400: 00000100:00100000:1.0:1784584653.341558:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065391551 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+11:3322:x1871272568949888:12345-0@lo:400: Request processed in 47us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584653.341564:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784584653.341611:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004345b49c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568949888:0@lo:400: 00000020:00000080:0.0:1784584653.341653:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x787d778cc3ff0d4e 00000004:00100000:0.0:1784584653.341713:0:5808:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784584653.341829:0:5808:0:(import.c:65:import_set_state_nolock()) 0000000007c2f815 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584653.341883:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eda7cda pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871272568950016:12345-0@lo:38: Request processed in 941us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584653.341891:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784584653.341922:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000c9764e3 x1871272568950016/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784584653.341936:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784584653.341949:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784584653.341954:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784584653.341956:0:3319:0:(import.c:65:import_set_state_nolock()) 00000000e5a96d38 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784584653.341961:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000c9764e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272568950016:0@lo:38: 10000000:01000000:2.0:1784584653.342949:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784584653.342954:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97c7d687f000 from 3 10000000:01000000:2.0:1784584653.342957:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784584653.342990:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 00000000687afd61/0x787d778cc3ff0d55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584653.343008:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 00000000687afd61/0x787d778cc3ff0d55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584653.343331:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 00000000687afd61/0x787d778cc3ff0d55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584653.343352:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003185b074 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568950144:0@lo:101: 00000100:00100000:2.0:1784584653.343407:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584653.343451:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000013681e47 going to sleep for 11 seconds 00000100:00100000:2.0:1784584653.343476:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568950144 00000100:00100000:2.0:1784584653.343482:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568950144 00000100:00100000:2.0:1784584653.343522:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584653.343529:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4153538 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+11:5803:x1871272568950144:12345-0@lo:101: 00010000:00010000:2.0:1784584653.343540:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584653.343552:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001620579c/0x787d778cc3ff0d5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0d55 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584653.343570:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001620579c/0x787d778cc3ff0d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0d55 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584653.343578:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001620579c/0x787d778cc3ff0d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d55 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584653.343586:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001620579c, rc 0) 00000100:00100000:2.0:1784584653.343678:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4153538 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568950144:12345-0@lo:101: Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584653.343685:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584653.343755:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003185b074 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568950144:0@lo:101: 00010000:00010000:2.0:1784584653.343768:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 00000000687afd61/0x787d778cc3ff0d55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584653.343776:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 00000000687afd61/0x787d778cc3ff0d55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584653.343819:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003185b074 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568950272:0@lo:256: 00000100:00100000:2.0:1784584653.343848:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584653.343928:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 0000000013681e47 going to sleep for 11 seconds 00000100:00100000:2.0:1784584653.343942:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568950272 00000100:00100000:2.0:1784584653.343952:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568950272 00000100:00100000:2.0:1784584653.343975:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584653.343980:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8b18156 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568950272:12345-0@lo:256: 20000000:01000000:2.0:1784584653.344151:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784584653.344166:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784584653.344169:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1784584653.344233:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8b18156 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568950272:12345-0@lo:256: Request processed in 253us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584653.344240:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584653.344268:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003185b074 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568950272:0@lo:256: 10000000:01000000:2.0:1784584653.344302:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784584653.344307:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: 00000000687afd61/0x787d778cc3ff0d55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584653.344315:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: 00000000687afd61/0x787d778cc3ff0d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584654.107979:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584655.132366:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584656.157134:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584657.182404:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784584657.313321:0:6284:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe759c0d60 20000000:00000080:3.0:1784584657.313339:0:6284:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c7f3d29400 uarg=0000000000000000 20000000:01000000:3.0:1784584657.313415:0:6284:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784584657.313422:0:6284:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784584657.313426:0:6284:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784584657.313617:0:6284:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1784584657.313627:0:6284:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1784584657.322314:0:6284:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584657.323513:0:6284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784584657.323583:0:6284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1784584657.323642:0:6284:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1784584657.323660:0:6284:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784584657.323677:0:6284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584657.323825:0:6284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d1d expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584657.323835:0:6284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584657.324165:0:6284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0d1d expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584657.324180:0:6284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0d1d expref: 11 pid: 5800 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584657.324193:0:6284:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000dd9e992 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6284:1871272568950400:0@lo:104: 00000100:00100000:3.0:1784584657.324255:0:6284:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584657.324356:0:6284:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aa3acfdc going to sleep for 11 seconds 00000100:00100000:0.0:1784584657.324382:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568950400 00000100:00100000:0.0:1784584657.324401:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568950400 00000100:00100000:0.0:1784584657.324450:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584657.324457:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000173daa3f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:6284:x1871272568950400:12345-0@lo:104: 00010000:00010000:0.0:1784584657.324469:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584657.324532:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584657.324537:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000173daa3f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:6284:x1871272568950400:12345-0@lo:104: Request processed in 81us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584657.324544:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784584657.326195:0:6284:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000dd9e992 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6284:1871272568950400:0@lo:104: 00010000:00010000:1.0:1784584657.326221:0:6284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.327718:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584657.327728:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.327739:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000069cd2fc6 already unused, calling callback (000000008a27fa8f) 10000000:00010000:2.0:1784584657.327743:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.327752:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584657.327759:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584657.327782:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584657.327830:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.327837:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584657.327861:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.327867:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: 0000000069cd2fc6/0x787d778cc3ff0d1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d24 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.327886:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584657.327888:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584657.327889:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584657.328284:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584657.328304:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003185b074 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568950528:0@lo:103: 00000100:00100000:3.0:1784584657.328370:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584657.328624:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568950528 00000100:00100000:2.0:1784584657.328632:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568950528 00010000:00010000:2.0:1784584657.328662:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d1d expref: 12 pid: 5800 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584657.328724:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584657.328801:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000319133d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+12:3322:x1871272568950528:12345-0@lo:103: 00010000:00010000:2.0:1784584657.328814:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584657.328819:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d1d expref: 12 pid: 5800 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.328830:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0d1d expref: 12 pid: 5800 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.328844:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004607e0f1/0x787d778cc3ff0d24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0d1d expref: 12 pid: 5800 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.328880:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.328887:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.328910:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.329151:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.329158:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.329164:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.329170:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1dbb6a2 already unused, calling callback (00000000e828231e) 00010000:00010000:2.0:1784584657.329173:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.329180:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.329201:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584657.329212:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584657.329264:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000319133d2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+11:3322:x1871272568950528:12345-0@lo:103: Request processed in 465us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584657.329281:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1784584657.329352:0:6284:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584657.329361:0:6284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584657.329366:0:6284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1dbb6a2/0x787d778cc3ff0d63 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584657.329657:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003185b074 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568950528:0@lo:103: 00010000:00010000:3.0:1784584658.204961:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584658.461621:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000082597167 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568950656:0@lo:400: 00000100:00100000:2.0:1784584658.461721:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584658.461791:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584658.461797:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000dc74716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568950784:0@lo:400: 00000100:00100000:2.0:1784584658.461826:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584658.461860:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568950656 00000100:00100000:2.0:1784584658.461866:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568950656 00000100:00100000:2.0:1784584658.461904:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584658.461984:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061644fe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+11:3320:x1871272568950656:12345-0@lo:400: 00000100:00100000:2.0:1784584658.462034:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061644fe5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+11:3320:x1871272568950656:12345-0@lo:400: Request processed in 52us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584658.462041:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584658.462076:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568950784 00000100:00100000:2.0:1784584658.462080:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568950784 00000100:00100000:2.0:1784584658.462106:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584658.462111:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c61fbd72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568950784:12345-0@lo:400: 00000100:00100000:2.0:1784584658.462140:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c61fbd72 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568950784:12345-0@lo:400: Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584658.462146:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784584658.462179:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000dc74716 x1871272568950784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584674 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584658.462191:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000dc74716 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568950784:0@lo:400: 00000100:00100000:2.0:1784584658.462202:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000082597167 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568950656:0@lo:400: 00010000:00010000:2.0:1784584659.236159:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584660.252239:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584661.277080:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784584662.043849:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584662.043855:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7d687f000 from 1 10000000:01000000:1.0:1784584662.043858:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584662.043899:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: 0000000084dcbf10/0x787d778cc3ff0d6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.043910:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: 0000000084dcbf10/0x787d778cc3ff0d6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.043939:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: 0000000084dcbf10/0x787d778cc3ff0d6a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584662.043963:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b3a94e1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568950912:0@lo:101: 00000100:00100000:1.0:1784584662.044031:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584662.044093:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 000000009cbc876e going to sleep for 11 seconds 00000100:00100000:3.0:1784584662.044917:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568950912 00000100:00100000:3.0:1784584662.044926:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568950912 00000100:00100000:3.0:1784584662.044980:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584662.044989:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000caf41c93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+11:5803:x1871272568950912:12345-0@lo:101: 00010000:00010000:3.0:1784584662.045003:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584662.045019:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f973379b/0x787d778cc3ff0d71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0d6a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.045043:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f973379b/0x787d778cc3ff0d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0d6a expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.045053:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f973379b/0x787d778cc3ff0d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d6a expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.045062:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f973379b, rc 0) 00000100:00100000:3.0:1784584662.045114:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000caf41c93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568950912:12345-0@lo:101: Request processed in 126us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584662.045120:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584662.045168:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b3a94e1a pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568950912:0@lo:101: 00010000:00010000:3.0:1784584662.045181:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: 0000000084dcbf10/0x787d778cc3ff0d6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.045189:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: 0000000084dcbf10/0x787d778cc3ff0d6a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584662.045257:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009dd6a127 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568951040:0@lo:501: 00000100:00100000:3.0:1784584662.045282:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584662.045302:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 000000008df058f1 going to sleep for 11 seconds 00000100:00100000:3.0:1784584662.045437:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568951040 00000100:00100000:3.0:1784584662.045442:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568951040 00000100:00100000:3.0:1784584662.045470:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784584662.045476:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059689d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568951040:12345-0@lo:501: 00000100:00100000:3.0:1784584662.046031:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059689d74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568951040:12345-0@lo:501: Request processed in 553us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584662.046039:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784584662.046077:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009dd6a127 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568951040:0@lo:501: 00000100:00100000:3.0:1784584662.046108:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000009dd6a127 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568951168:0@lo:503: 00000100:00100000:3.0:1784584662.046144:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584662.046163:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bf634cdc going to sleep for 11 seconds 00000100:00100000:3.0:1784584662.046173:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568951168 00000100:00100000:3.0:1784584662.046177:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568951168 00000100:00100000:3.0:1784584662.046196:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784584662.046201:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033d1d9ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568951168:12345-0@lo:503: 00000100:00100000:3.0:1784584662.046609:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033d1d9ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568951168:12345-0@lo:503: Request processed in 406us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584662.046617:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784584662.047151:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000009dd6a127 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568951168:0@lo:503: 00000100:00100000:3.0:1784584662.050521:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000a3aa7b50 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6604:1871272568951296:0@lo:502: 00000100:00100000:3.0:1784584662.050602:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584662.050649:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set 00000000bf634cdc going to sleep for 11 seconds 00000100:00100000:2.0:1784584662.050737:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568951296 00000100:00100000:2.0:1784584662.050744:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568951296 00000100:00100000:2.0:1784584662.050781:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584662.050789:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007102907 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:6604:x1871272568951296:12345-0@lo:502: 00000100:00100000:2.0:1784584662.051012:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007102907 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:6604:x1871272568951296:12345-0@lo:502: Request processed in 224us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.051019:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784584662.051231:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000a3aa7b50 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6604:1871272568951296:0@lo:502: 00000020:01000000:3.0:1784584662.051258:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584662.051268:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584662.051270:0:6604:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784584662.051276:0:6604:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7d687f000 00000020:00000080:3.0:1784584662.051279:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784584662.051316:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6604:1871272568951424:0@lo:502: 00000100:00100000:3.0:1784584662.051350:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584662.051385:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584662.051506:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568951424 00000100:00100000:2.0:1784584662.051511:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568951424 00000100:00100000:2.0:1784584662.051540:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584662.051546:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:6604:x1871272568951424:12345-0@lo:502: 00000100:00100000:2.0:1784584662.051652:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:6604:x1871272568951424:12345-0@lo:502: Request processed in 105us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.051658:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784584662.051812:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6604:1871272568951424:0@lo:502: 00000020:01000000:3.0:1784584662.051832:0:6604:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584662.051835:0:6604:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584662.051837:0:6604:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784584662.051840:0:6604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1784584662.052065:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784584662.052084:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584662.052094:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.052104:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784584662.107243:0:6602:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1784584662.107247:0:6602:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1784584662.107399:0:6602:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97c7c7f3c000 00000020:01000004:2.0:1784584662.107414:0:6602:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1784584662.107425:0:6602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784584662.107438:0:6602:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97c7fbd03380) 00000020:00000080:2.0:1784584662.107524:0:6602:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784584662.129337:0:6602:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784584662.129786:0:6602:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1784584662.166910:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784584662.176599:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784584662.176633:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784584662.176802:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784584662.176968:0:6602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784584662.178615:0:6602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784584662.178629:0:6602:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784584662.178642:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x787d778cc3ff0d7f 00000020:01000004:2.0:1784584662.178651:0:6602:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784584662.178674:0:6602:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784584662.178677:0:6602:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784584662.178684:0:6602:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784584662.178872:0:6602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784584662.178887:0:6602:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97c7fbd00000) 00000020:00000080:2.0:1784584662.178899:0:6602:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1784584662.180069:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584662.180216:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784584662.180222:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784584662.182818:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784584662.182831:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1784584662.184115:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1784584662.184125:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1784584662.190435:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584662.190608:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1784584662.190614:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1784584662.192103:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1784584662.192113:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1784584662.209419:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584662.209647:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1784584662.209654:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1784584662.211346:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1784584662.211368:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1784584662.212246:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1784584662.212254:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1784584662.215321:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584662.215549:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1784584662.215555:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1784584662.216291:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1784584662.216299:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1784584662.251345:0:6602:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584662.251527:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1784584662.251534:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1784584662.252552:0:6602:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1784584662.252561:0:6602:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1784584662.253031:0:6602:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1784584662.253054:0:6602:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1784584662.253059:0:6602:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1784584662.268024:0:6602:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784584662.268058:0:6602:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1784584662.268062:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784584662.268064:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784584662.268065:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584662.268066:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584662.268068:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584662.268069:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584662.268070:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584662.268071:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784584662.268073:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784584662.268074:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584662.268076:0:6602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584662.268079:0:6602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1784584662.268082:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584662.268083:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784584662.268084:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584662.268085:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584662.268087:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584662.268088:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584662.268089:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584662.268090:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784584662.268091:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784584662.268092:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584662.268093:0:6602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584662.268119:0:6602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784584662.268137:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568951552:0@lo:253: 00000100:00100000:1.0:1784584662.268212:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584662.268317:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c414b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584662.268403:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568951552 00000100:00100000:3.0:1784584662.268410:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568951552 00000100:00100000:3.0:1784584662.268495:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784584662.268504:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568951552:12345-0@lo:253: 20000000:01000000:3.0:1784584662.268541:0:5800:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784584662.268545:0:5800:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1784584662.268549:0:5800:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1784584662.268552:0:5800:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1784584662.269424:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584662.269642:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1784584662.269655:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1784584662.269726:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1784584662.269741:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1784584662.269771:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1784584662.269820:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1784584662.270157:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1784584662.270175:0:5800:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:3.0:1784584662.270177:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1784584662.270211:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1784584662.270220:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784584662.270265:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1784584662.270273:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1784584662.270306:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1784584662.270315:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784584662.270346:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1784584662.270412:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1784584662.271068:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1784584662.271085:0:5800:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:3.0:1784584662.271086:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:3.0:1784584662.271120:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1784584662.271127:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784584662.271154:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1784584662.271161:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:3.0:1784584662.271203:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1784584662.271212:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1784584662.271243:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1784584662.271277:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1784584662.271292:0:5800:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784584662.271295:0:5800:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784584662.271298:0:5800:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784584662.271309:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784584662.271312:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784584662.271342:0:5800:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784584662.271345:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784584662.272380:0:6618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1784584662.272632:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1784584662.272853:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1784584662.272923:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1784584662.272936:0:5800:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784584662.272938:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784584662.273365:0:6619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1784584662.273414:0:6619:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1784584662.273463:0:6619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1784584662.273901:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1784584662.273941:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1784584662.273976:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1784584662.273988:0:5800:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784584662.273990:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784584662.274401:0:6620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1784584662.274446:0:6620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1784584662.274493:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1784584662.274811:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1784584662.274850:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1784584662.274897:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1784584662.274913:0:5800:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1784584662.274916:0:5800:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1784584662.274926:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1784584662.274950:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.274966:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0ca6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0c9f expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.274973:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c1513000/0x787d778cc3ff0cc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0cbb expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.274979:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0d32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d2b expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.274984:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.275020:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0d32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0d2b expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.275035:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0d32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0d2b expref: 12 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584662.275048:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1871272568951680:0@lo:104: 00000100:00100000:0.0:1784584662.275106:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784584662.275205:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c1513000/0x787d778cc3ff0cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0cbb expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.275213:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c1513000/0x787d778cc3ff0cc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0cbb expref: 12 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584662.275222:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1871272568951808:0@lo:104: 00000100:00100000:0.0:1784584662.275244:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784584662.275371:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0c9f expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.275379:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0ca6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0c9f expref: 12 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584662.275387:0:5800:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1871272568951936:0@lo:104: 00000100:00100000:0.0:1784584662.275409:0:5800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584662.275460:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568951680 00000100:00100000:3.0:1784584662.275466:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568951680 00000100:00100000:3.0:1784584662.275499:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568951808 00000100:00100000:3.0:1784584662.275502:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568951808 00000100:00100000:3.0:1784584662.275514:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584662.275521:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+4:5800:x1871272568951680:12345-0@lo:104: 00010000:00010000:3.0:1784584662.275533:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.275585:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584662.275591:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+4:5800:x1871272568951680:12345-0@lo:104: Request processed in 70us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584662.275598:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584662.275612:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584662.275617:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:5800:x1871272568951808:12345-0@lo:104: 00010000:00010000:3.0:1784584662.275625:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.275652:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784584662.275662:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:5800:x1871272568951808:12345-0@lo:104: Request processed in 46us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584662.275668:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1784584662.275743:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584662.275749:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275756:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fc800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584662.275760:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275768:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584662.275781:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584662.275787:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584662.275822:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275829:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584662.275850:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275857:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d32 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275870:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584662.275874:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275880:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166ea00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584662.275883:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275888:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584662.275893:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584662.275898:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584662.275917:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0cbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275923:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584662.275928:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0cbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275934:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0cbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0cc2 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.275943:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584662.275945:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584662.275946:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584662.275952:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584662.275962:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568952064:0@lo:103: 00000100:00100000:2.0:1784584662.275992:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.276022:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584662.276027:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568952192:0@lo:103: 00000100:00100000:2.0:1784584662.276047:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.276074:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568952064 00000100:00100000:2.0:1784584662.276077:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568952064 00010000:00010000:2.0:1784584662.276097:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0d32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d2b expref: 13 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.276117:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568952192 00000100:00100000:2.0:1784584662.276120:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568952192 00010000:00010000:2.0:1784584662.276131:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c1513000/0x787d778cc3ff0cc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0cbb expref: 14 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.276143:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584662.276149:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+14:3322:x1871272568952064:12345-0@lo:103: 00010000:00010000:2.0:1784584662.276165:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584662.276170:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0d32 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d2b expref: 14 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.276180:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0d32 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0d2b expref: 14 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.276194:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584662.276222:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+14:3322:x1871272568952064:12345-0@lo:103: Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.276229:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584662.276243:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584662.276249:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+13:3322:x1871272568952192:12345-0@lo:103: 00010000:00010000:2.0:1784584662.276255:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584662.276259:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c1513000/0x787d778cc3ff0cc2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0cbb expref: 13 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.276268:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c1513000/0x787d778cc3ff0cc2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0cbb expref: 13 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.276276:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584662.276298:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+13:3322:x1871272568952192:12345-0@lo:103: Request processed in 49us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.276303:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584662.276339:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568952192:0@lo:103: 00000100:00100000:2.0:1784584662.276347:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568952064:0@lo:103: 00000100:00100000:0.0:1784584662.276504:0:5800:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798480 going to sleep for 11 seconds 00010000:00010000:0.0:1784584662.276518:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0d32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0d2b expref: 12 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584662.276528:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1871272568951680:0@lo:104: 00010000:00010000:0.0:1784584662.276536:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1513000/0x787d778cc3ff0cc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0cbb expref: 11 pid: 5800 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584662.276545:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1871272568951808:0@lo:104: 00000100:00100000:3.0:1784584662.276685:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568951936 00000100:00100000:3.0:1784584662.276713:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568951936 00000100:00100000:3.0:1784584662.276734:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784584662.276739:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:5800:x1871272568951936:12345-0@lo:104: 00010000:00010000:3.0:1784584662.276747:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.276789:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584662.276794:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:5800:x1871272568951936:12345-0@lo:104: Request processed in 55us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584662.276799:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584662.276861:0:5800:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5800:1871272568951936:0@lo:104: 00010000:00010000:0.0:1784584662.276878:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.276932:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584662.276936:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.276952:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c0031800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584662.276955:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.276963:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584662.276969:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0c9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584662.276974:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584662.277004:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0c9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277010:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584662.277032:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0c9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277037:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0c9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ca6 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277051:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584662.277052:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584662.277054:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584662.277061:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784584662.277070:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568952320:0@lo:103: 00000100:00100000:2.0:1784584662.277095:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.277116:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568952320 00000100:00100000:2.0:1784584662.277119:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568952320 00010000:00010000:2.0:1784584662.277136:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0ca6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0c9f expref: 11 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.277154:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584662.277159:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+11:3321:x1871272568952320:12345-0@lo:103: 00010000:00010000:2.0:1784584662.277166:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584662.277170:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0ca6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0c9f expref: 11 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277178:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0c9f expref: 11 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277188:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0ca6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0c9f expref: 11 pid: 5799 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277200:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277207:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277218:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277226:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277233:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277239:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277253:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c0031000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584662.277257:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277264:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277275:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.277284:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584662.277310:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+10:3321:x1871272568952320:12345-0@lo:103: Request processed in 151us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.277316:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584662.277341:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568952320:0@lo:103: 00010000:00010000:0.0:1784584662.277396:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.277403:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.277409:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0d8d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784584662.277429:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1784584662.299971:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584662.315850:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+9:6602:x1871272568951552:12345-0@lo:253: Request processed in 47339us (47630us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584662.315864:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584662.316053:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568951552:0@lo:253: 10000000:01000000:2.0:1784584662.316067:0:6602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784584662.316070:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584662.316072:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784584662.316074:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584662.316075:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1784584662.316077:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584662.316078:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584662.316079:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784584662.316081:0:6602:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1784584662.316082:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584662.316084:0:6602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784584662.316103:0:6602:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c7c7f3c000 from lustre-OST0000 10000000:01000000:2.0:1784584662.316126:0:6602:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1784584662.316129:0:6602:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784584662.316211:0:6602:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97c7c5d4b380 local copy 10000000:01000000:2.0:1784584662.316215:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784584662.316252:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.316262:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.316271:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.316290:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568952448:0@lo:101: 00000100:00100000:2.0:1784584662.316393:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.316495:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcf63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584662.316630:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568952448 00000100:00100000:3.0:1784584662.316637:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568952448 00000100:00100000:3.0:1784584662.316724:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1784584662.316732:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+9:6602:x1871272568952448:12345-0@lo:101: 00010000:00010000:3.0:1784584662.316744:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584662.316756:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c1512c00/0x787d778cc3ff0d9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0d94 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.316777:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c1512c00/0x787d778cc3ff0d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0d94 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.316787:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c1512c00/0x787d778cc3ff0d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d94 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.316796:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c1512c00, rc 0) 00000100:00100000:3.0:1784584662.316843:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+10:6602:x1871272568952448:12345-0@lo:101: Request processed in 112us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584662.316849:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784584662.316921:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568952448:0@lo:101: 00010000:00010000:1.0:1784584662.316936:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.316945:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584662.317045:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568952576:0@lo:501: 00000100:00100000:1.0:1784584662.317072:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584662.317312:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c414bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584662.317446:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568952576 00000100:00100000:2.0:1784584662.317556:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568952576 00000100:00100000:2.0:1784584662.317579:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784584662.317586:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+10:6602:x1871272568952576:12345-0@lo:501: 00000100:00100000:2.0:1784584662.317844:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+10:6602:x1871272568952576:12345-0@lo:501: Request processed in 257us (770us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584662.317852:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584662.318071:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568952576:0@lo:501: 10000000:01000000:1.0:1784584662.318087:0:6602:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784584662.318114:0:6602:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784584662.318121:0:6602:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.318130:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.318137:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.318263:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784584662.318284:0:6602:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c7c7f3c000 10000000:01000000:1.0:1784584662.318289:0:6602:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784584662.318293:0:6602:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97c7c5d4b380 10000000:01000000:1.0:1784584662.318295:0:6602:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1784584662.318299:0:6602:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97c7c5d4b380 from 1 10000000:01000000:1.0:1784584662.318371:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784584662.318397:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.318406:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.318426:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584662.318440:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568952704:0@lo:101: 00000100:00100000:1.0:1784584662.318484:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584662.318513:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c414bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584662.318606:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568952704 00000100:00100000:3.0:1784584662.318611:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568952704 00000100:00100000:3.0:1784584662.318646:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1784584662.318653:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+10:6602:x1871272568952704:12345-0@lo:101: 00010000:00010000:3.0:1784584662.318662:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584662.318673:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c1512600/0x787d778cc3ff0da9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0da2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.318706:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c1512600/0x787d778cc3ff0da9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0da2 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.318716:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c1512600/0x787d778cc3ff0da9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0da2 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.318724:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c1512600, rc 0) 00000100:00100000:3.0:1784584662.318759:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+11:6602:x1871272568952704:12345-0@lo:101: Request processed in 107us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584662.318764:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784584662.318865:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568952704:0@lo:101: 00010000:00010000:1.0:1784584662.318876:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0da9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.318949:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0da9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584662.318965:0:6602:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784584662.318979:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0da9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.318986:0:6602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0da9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584662.318992:0:6602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784584662.318996:0:6602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584662.319000:0:6602:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1784584662.319002:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784584662.319015:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.319022:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.319035:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584662.319046:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568952832:0@lo:101: 00000100:00100000:1.0:1784584662.319070:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584662.319167:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c414bf00 going to sleep for 11 seconds 00010000:00010000:2.0:1784584662.319266:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584662.319272:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.319279:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fc800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584662.319283:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.319291:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584662.319380:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584662.319386:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584662.319406:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.319412:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784584662.319465:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568952960:0@lo:103: 00000100:00100000:3.0:1784584662.319493:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584662.319585:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.319593:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0d94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x787d778cc3ff0d9b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.319607:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584662.319609:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584662.319611:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584662.319664:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568952960 00000100:00100000:1.0:1784584662.319669:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568952960 00000100:00100000:1.0:1784584662.319727:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584662.319735:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+11:3321:x1871272568952960:12345-0@lo:103: 00010000:00010000:1.0:1784584662.319745:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584662.319757:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1512c00/0x787d778cc3ff0d9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0d94 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.319769:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584662.320039:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568952832 00000100:00100000:0.0:1784584662.320044:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568952832 00000100:00100000:0.0:1784584662.320076:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584662.320084:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+11:6602:x1871272568952832:12345-0@lo:101: 00010000:00010000:0.0:1784584662.320094:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584662.320104:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0db0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.320120:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0db0 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.320129:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0db0 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.320136:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c0031000, rc 0) 00000100:00100000:0.0:1784584662.320270:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568952832:12345-0@lo:101: Request processed in 186us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584662.320277:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784584662.320414:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568952832:0@lo:101: 00010000:00010000:2.0:1784584662.320427:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.320434:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.320537:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953088:0@lo:501: 00000100:00100000:2.0:1784584662.320565:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.320587:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcf6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584662.320669:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568953088 00000100:00100000:0.0:1784584662.320674:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568953088 00000100:00100000:0.0:1784584662.320722:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1784584662.320729:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953088:12345-0@lo:501: 00000100:00100000:0.0:1784584662.321009:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953088:12345-0@lo:501: Request processed in 280us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584662.321023:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784584662.321125:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953088:0@lo:501: 00000100:00100000:2.0:1784584662.323253:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953216:0@lo:503: 00000100:00100000:2.0:1784584662.323392:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.323427:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcf6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584662.323520:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568953216 00000100:00100000:0.0:1784584662.323528:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568953216 00000100:00100000:0.0:1784584662.323581:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784584662.323590:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953216:12345-0@lo:503: 00000100:00100000:0.0:1784584662.323789:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953216:12345-0@lo:503: Request processed in 199us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584662.323797:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584662.324000:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953216:0@lo:503: 00000040:00080000:2.0:1784584662.324485:0:6602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584662.324553:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953344:0@lo:502: 00000100:00100000:2.0:1784584662.324591:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.324622:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcf6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584662.324674:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568953344 00000100:00100000:0.0:1784584662.324678:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568953344 00000100:00100000:0.0:1784584662.324726:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784584662.324733:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953344:12345-0@lo:502: 00000100:00100000:0.0:1784584662.324857:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953344:12345-0@lo:502: Request processed in 123us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584662.324863:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784584662.325010:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+11:3321:x1871272568952960:12345-0@lo:103: Request processed in 5274us (5514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584662.325019:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584662.325102:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953344:0@lo:502: 00000040:00080000:2.0:1784584662.325475:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784584662.325524:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1784584662.325555:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1784584662.325612:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1784584662.325650:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1784584662.325679:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1784584662.325730:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953472:0@lo:502: 00000100:00100000:2.0:1784584662.325767:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.325788:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcf6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584662.325804:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568953472 00000100:00100000:2.0:1784584662.325808:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568953472 00000100:00100000:2.0:1784584662.325837:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584662.325844:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+11:6602:x1871272568953472:12345-0@lo:502: 00000100:00100000:2.0:1784584662.326084:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+11:6602:x1871272568953472:12345-0@lo:502: Request processed in 239us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.326092:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584662.326133:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953472:0@lo:502: 00000040:00080000:2.0:1784584662.326278:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1784584662.326287:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000100:00100000:3.0:1784584662.327096:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568952960:0@lo:103: 00000020:01000000:1.0:1784584662.327507:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784584662.327516:0:6622:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1784584662.327522:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584662.327525:0:6622:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1784584662.327530:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784584662.327545:0:6622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97c7d8a7b380) 00000020:00000080:1.0:1784584662.327563:0:6622:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784584662.327568:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784584662.327639:0:6622:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c7c7f3c000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1784584662.327646:0:6622:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784584662.327658:0:6622:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x787d778cc3ff0dc5 00010000:00010000:1.0:1784584662.335113:0:6622:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1784584662.336122:0:6622:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1784584662.340986:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784584662.341280:0:6622:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1784584662.350048:0:6622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784584662.351516:0:6622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1784584662.355155:0:6622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1784584662.355166:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584662.355173:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584662.355175:0:6622:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1784584662.355178:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584662.355182:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584662.355183:0:6622:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784584662.355186:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784584662.355188:0:6622:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784584662.355240:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584662.355244:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584662.355245:0:6622:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784584662.355248:0:6622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1784584662.357900:0:6602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1784584662.357935:0:6602:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1784584662.357998:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.358011:0:6602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584662.358019:0:6602:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7c7f3c000 from 1 10000000:01000000:2.0:1784584662.358021:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584662.358057:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.358065:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.358075:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.358098:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953600:0@lo:101: 00000100:00100000:2.0:1784584662.358157:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.358206:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e034a000 going to sleep for 11 seconds 00000100:00100000:1.0:1784584662.358664:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568953600 00000100:00100000:1.0:1784584662.358671:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568953600 00000100:00100000:1.0:1784584662.358737:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784584662.358746:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+11:6602:x1871272568953600:12345-0@lo:101: 00010000:00010000:1.0:1784584662.358760:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584662.358781:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0dcc expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.358805:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0dcc expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.358815:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0dcc expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.358824:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c166f800, rc 0) 00000100:00100000:1.0:1784584662.358863:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953600:12345-0@lo:101: Request processed in 118us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584662.358869:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584662.361789:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953600:0@lo:101: 00010000:00010000:2.0:1784584662.361839:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.361852:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.361962:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953728:0@lo:501: 00000100:00100000:2.0:1784584662.362013:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.362053:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e034a000 going to sleep for 11 seconds 00000100:00100000:1.0:1784584662.362334:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568953728 00000100:00100000:1.0:1784584662.362341:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568953728 00000100:00100000:1.0:1784584662.362396:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784584662.362405:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953728:12345-0@lo:501: 00000100:00100000:1.0:1784584662.362656:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953728:12345-0@lo:501: Request processed in 252us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584662.362664:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784584662.363685:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953728:0@lo:501: 00000100:00100000:2.0:1784584662.363749:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953856:0@lo:503: 00000100:00100000:2.0:1784584662.363806:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.363834:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e034a000 going to sleep for 11 seconds 00000100:00100000:2.0:1784584662.363852:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568953856 00000100:00100000:2.0:1784584662.363857:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568953856 00000100:00100000:2.0:1784584662.363889:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784584662.363897:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953856:12345-0@lo:503: 00000100:00100000:2.0:1784584662.364053:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953856:12345-0@lo:503: Request processed in 157us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.364060:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784584662.364106:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953856:0@lo:503: 00000040:00080000:2.0:1784584662.364377:0:6602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584662.365119:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953984:0@lo:502: 00000100:00100000:2.0:1784584662.365163:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.365195:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584662.365329:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568953984 00000100:00100000:1.0:1784584662.365343:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568953984 00000100:00100000:1.0:1784584662.365390:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784584662.365397:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953984:12345-0@lo:502: 00000100:00100000:1.0:1784584662.365571:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568953984:12345-0@lo:502: Request processed in 174us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584662.365578:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784584662.365855:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568953984:0@lo:502: 00000040:00080000:0.0:1784584662.366090:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784584662.366139:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784584662.366165:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954112:0@lo:502: 00000100:00100000:0.0:1784584662.366202:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584662.366221:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584662.366860:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568954112 00000100:00100000:2.0:1784584662.366874:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568954112 00000100:00100000:2.0:1784584662.366911:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784584662.366919:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568954112:12345-0@lo:502: 00000100:00100000:2.0:1784584662.367077:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568954112:12345-0@lo:502: Request processed in 158us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.367084:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784584662.369019:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954112:0@lo:502: 00000040:00080000:0.0:1784584662.369182:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1784584662.369195:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1784584662.371063:0:6626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584662.371073:0:6626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584662.371075:0:6626:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784584662.371082:0:6626:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7c7f3c000 00000020:00000080:0.0:1784584662.371084:0:6626:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584662.371098:0:6626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584662.371101:0:6626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584662.371102:0:6626:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784584662.371105:0:6626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784584662.371632:0:6602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784584662.371666:0:6602:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584662.371683:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.371721:0:6602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584662.371760:0:6602:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784584662.371763:0:6602:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c7c7f3c000 10000000:01000000:2.0:1784584662.371766:0:6602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c7c7f3c000 10000000:01000000:2.0:1784584662.371770:0:6602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784584662.371774:0:6602:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7c7f3c000 from 1 10000000:01000000:2.0:1784584662.371777:0:6602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784584662.371806:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.371814:0:6602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.371825:0:6602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.371844:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954240:0@lo:101: 00000100:00100000:2.0:1784584662.372959:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.373041:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e92f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584662.373116:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568954240 00000100:00100000:3.0:1784584662.373122:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568954240 00000100:00100000:3.0:1784584662.373171:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784584662.373180:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568954240:12345-0@lo:101: 00010000:00010000:3.0:1784584662.373203:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584662.373219:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0dda expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.373243:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0dda expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.373255:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0dda expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.373262:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c1512e00, rc 0) 00000100:00100000:3.0:1784584662.373351:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568954240:12345-0@lo:101: Request processed in 172us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584662.373366:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784584662.373431:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954240:0@lo:101: 00010000:00010000:2.0:1784584662.373448:0:6602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.373457:0:6602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.373566:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954368:0@lo:501: 00000100:00100000:2.0:1784584662.373594:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.374043:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584662.374043:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568954368 00000100:00100000:1.0:1784584662.374048:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568954368 00000100:00100000:1.0:1784584662.374073:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784584662.374081:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568954368:12345-0@lo:501: 00000100:00100000:1.0:1784584662.374299:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568954368:12345-0@lo:501: Request processed in 217us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584662.374384:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784584662.375229:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954368:0@lo:501: 00000100:00100000:2.0:1784584662.375273:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954496:0@lo:503: 00000100:00100000:2.0:1784584662.375323:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584662.375364:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e92f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584662.375394:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568954496 00000100:00100000:1.0:1784584662.375399:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568954496 00000100:00100000:1.0:1784584662.375438:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784584662.375445:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568954496:12345-0@lo:503: 00000100:00100000:1.0:1784584662.375615:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568954496:12345-0@lo:503: Request processed in 170us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584662.375622:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784584662.375735:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954496:0@lo:503: 00000040:00080000:0.0:1784584662.376147:0:6602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784584662.376204:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954624:0@lo:502: 00000100:00100000:0.0:1784584662.376816:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584662.376850:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798540 going to sleep for 11 seconds 00000100:00100000:2.0:1784584662.376901:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568954624 00000100:00100000:2.0:1784584662.376907:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568954624 00000100:00100000:2.0:1784584662.376941:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784584662.376950:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568954624:12345-0@lo:502: 00000100:00100000:2.0:1784584662.377147:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568954624:12345-0@lo:502: Request processed in 197us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.377154:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784584662.377199:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954624:0@lo:502: 00000040:00080000:0.0:1784584662.377520:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1784584662.377571:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1784584662.377601:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1784584662.377643:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1784584662.377676:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1784584662.378540:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1784584662.378571:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1784584662.378597:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1784584662.378635:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1784584662.378667:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1784584662.379730:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1784584662.379817:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1784584662.379880:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1784584662.379927:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1784584662.379973:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1784584662.380009:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1784584662.380149:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1784584662.380206:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1784584662.380242:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1784584662.380273:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1784584662.380318:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1784584662.380350:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1784584662.380487:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1784584662.380534:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1784584662.380569:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1784584662.380599:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1784584662.380661:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1784584662.380749:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1784584662.380796:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954752:0@lo:502: 00000100:00100000:0.0:1784584662.380868:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584662.381169:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798540 going to sleep for 11 seconds 00000100:00100000:1.0:1784584662.386241:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568954752 00000100:00100000:1.0:1784584662.386254:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568954752 00000100:00100000:1.0:1784584662.386439:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784584662.386452:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568954752:12345-0@lo:502: 00000100:00100000:1.0:1784584662.386876:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568954752:12345-0@lo:502: Request processed in 426us (6005us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584662.386948:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568954752:0@lo:502: 00000040:00080000:0.0:1784584662.387075:0:6602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1784584662.387089:0:6602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00100000:1.0:1784584662.387506:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000020:01000004:3.0:1784584662.389621:0:6627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784584662.389646:0:6627:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97c7c7f899c0) 00000020:00000080:3.0:1784584662.389671:0:6627:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1784584662.390120:0:6627:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c7c7f3c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784584662.390126:0:6627:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c7c7f3c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1784584662.390128:0:6627:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7c7f3c000 3 00010000:00080000:2.0:1784584662.390155:0:6627:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7ffc53000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1784584662.402240:0:6627:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1784584662.402345:0:6627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1784584662.402393:0:6627:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784584662.402408:0:6627:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x787d778cc3ff0def 00000100:00080000:2.0:1784584662.402419:0:6627:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584662.402424:0:6627:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97c7ffc53000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1784584662.402458:0:6627:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7c40f7480 x1871272568954880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584662.402542:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1871272568954880:0@lo:38: 00000100:00100000:3.0:1784584662.402610:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584662.402769:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568954880 00000100:00100000:1.0:1784584662.402777:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568954880 00000100:00100000:1.0:1784584662.402813:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784584662.402820:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1871272568954880:12345-0@lo:38: 00010000:00080000:1.0:1784584662.402841:0:5808:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:1.0:1784584662.402868:0:5808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x787d778cc3ff0df6 00000004:00100000:1.0:1784584662.402890:0:5808:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784584662.402922:0:5808:0:(import.c:65:import_set_state_nolock()) ffff97c8019f1000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1784584662.403712:0:6627:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784584662.405363:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871272568954880:12345-0@lo:38: Request processed in 2526us (2736us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584662.405375:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784584662.405467:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568955008:0@lo:400: 00000100:00100000:1.0:1784584662.405514:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584662.405558:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568955008 00000100:00100000:1.0:1784584662.405564:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568955008 00000100:00100000:1.0:1784584662.405598:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784584662.405605:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568955008:12345-0@lo:400: 00000040:00080000:2.0:1784584662.405998:0:6627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:3.0:1784584662.406083:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c7c40f7480 x1871272568954880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584662.406094:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1784584662.406103:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1784584662.406109:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1784584662.406114:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784584662.406117:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7ffc53000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784584662.406124:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1871272568954880:0@lo:38: 00000100:00100000:1.0:1784584662.407527:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568955008:12345-0@lo:400: Request processed in 1915us (2006us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584662.407539:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784584662.407600:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c801b1ca80 x1871272568955008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584662.407613:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568955008:0@lo:400: 00000020:01000000:1.0:1784584662.407982:0:6602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1784584662.408009:0:6602:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584662.409952:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.409987:0:6602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784584662.410040:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784584662.410042:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784584662.410044:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584662.410045:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584662.410047:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584662.410048:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584662.410050:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584662.410051:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784584662.410053:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784584662.410054:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584662.410056:0:6602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584662.410059:0:6602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1784584662.410062:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584662.410063:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784584662.410064:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584662.410065:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584662.410067:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584662.410068:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584662.410069:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584662.410070:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784584662.410071:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784584662.410072:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584662.410073:0:6602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584662.410109:0:6602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1784584662.410148:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568955136:0@lo:253: 00000100:00100000:1.0:1784584662.410210:0:6602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584662.410250:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c414b540 going to sleep for 11 seconds 00000100:00100000:1.0:1784584662.410273:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568955136 00000100:00100000:1.0:1784584662.410279:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568955136 00000100:00100000:1.0:1784584662.410319:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784584662.410327:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:6602:x1871272568955136:12345-0@lo:253: 20000000:01000000:1.0:1784584662.410381:0:5800:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1784584662.410393:0:5800:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784584662.483174:0:5800:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784584662.483196:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784584662.483880:0:5822:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784584662.483887:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784584662.483908:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.483927:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c13fc400/0x787d778cc3ff0d5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d55 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.483936:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.483974:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c13fc400/0x787d778cc3ff0d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0d55 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.483986:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c13fc400/0x787d778cc3ff0d5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0d55 expref: 13 pid: 5798 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584662.484001:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5822:1871272568955264:0@lo:104: 00000100:00100000:3.0:1784584662.484060:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584662.484128:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4269a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584662.484258:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568955264 00000100:00100000:0.0:1784584662.484266:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568955264 00000100:00100000:0.0:1784584662.484511:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584662.484521:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:5822:x1871272568955264:12345-0@lo:104: 00010000:00010000:0.0:1784584662.484533:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff0d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584662.484592:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584662.484598:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:5822:x1871272568955264:12345-0@lo:104: Request processed in 80us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584662.484605:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584662.484735:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5822:1871272568955264:0@lo:104: 00010000:00010000:3.0:1784584662.484754:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.484930:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584662.484938:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff0d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.484947:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fd600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584662.484952:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff0d55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.484960:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff0d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584662.484967:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff0d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584662.484972:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584662.485012:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff0d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.485030:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584662.485117:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff0d55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.485124:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff0d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d5c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584662.485140:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584662.485142:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584662.485144:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584662.485157:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568955392:0@lo:103: 00000100:00100000:2.0:1784584662.485199:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584662.485273:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568955392 00000100:00100000:1.0:1784584662.485279:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568955392 00010000:00010000:1.0:1784584662.485313:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c13fc400/0x787d778cc3ff0d5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d55 expref: 14 pid: 5798 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584662.485343:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584662.485351:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+14:3323:x1871272568955392:12345-0@lo:103: 00010000:00010000:1.0:1784584662.485373:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584662.485378:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c13fc400/0x787d778cc3ff0d5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d55 expref: 14 pid: 5798 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485389:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c13fc400/0x787d778cc3ff0d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0d55 expref: 14 pid: 5798 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485402:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fc400/0x787d778cc3ff0d5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0d55 expref: 14 pid: 5798 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485416:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485424:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784584662.485437:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002266972s 00010000:00010000:1.0:1784584662.485442:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485450:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485468:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485475:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485480:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c1513200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584662.485484:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485492:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485513:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584662.485523:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584662.485568:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f60850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+13:3323:x1871272568955392:12345-0@lo:103: Request processed in 218us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584662.485575:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1784584662.485666:0:5822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.485675:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584662.485681:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0dfd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584662.485918:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568955392:0@lo:103: 00000100:00100000:2.0:1784584662.503186:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:6602:x1871272568955136:12345-0@lo:253: Request processed in 92852us (92967us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584662.503201:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784584662.503314:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:6602:1871272568955136:0@lo:253: 10000000:01000000:1.0:1784584662.503329:0:6602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784584662.503332:0:6602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784584662.503334:0:6602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784584662.503335:0:6602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584662.503336:0:6602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584662.503337:0:6602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584662.503339:0:6602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584662.503340:0:6602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584662.503341:0:6602:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784584662.503343:0:6602:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784584662.503365:0:6602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584662.503366:0:6602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1784584662.503381:0:6602:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1784584662.524457:0:6602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1784584662.524637:0:6602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1784584662.526394:0:6602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1784584662.527771:0:6602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1784584662.528196:0:6602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1784584662.528464:0:6602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784584662.529595:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1784584662.734206:0:6602:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784584662.734213:0:6602:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784584662.734246:0:6602:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784584662.734296:0:6602:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784584662.734309:0:6602:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1784584662.734332:0:6602:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1784584663.325201:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584664.350244:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584665.372441:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584666.396141:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584667.420266:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584667.676147:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272568955648:0@lo:400: 00000100:00100000:0.0:1784584667.676374:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584667.676387:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568955776:0@lo:400: 00000100:00100000:1.0:1784584667.676434:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568955520:0@lo:400: 00000100:00100000:0.0:1784584667.677308:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584667.677400:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568955776 00000100:00100000:0.0:1784584667.677407:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568955776 00000100:00100000:0.0:1784584667.677457:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584667.677465:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568955776:12345-0@lo:400: 00000100:00100000:0.0:1784584667.677511:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568955776:12345-0@lo:400: Request processed in 47us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584667.677517:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1784584667.677536:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784584667.677561:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8010bea00 x1871272568955776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584667.677574:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568955776:0@lo:400: 00000100:00100000:3.0:1784584667.678467:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584667.678989:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584667.679033:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568955648 00000100:00100000:1.0:1784584667.679039:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568955648 00000100:00100000:1.0:1784584667.679075:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784584667.679083:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272568955648:12345-0@lo:400: 00000100:00100000:1.0:1784584667.679143:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272568955648:12345-0@lo:400: Request processed in 62us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584667.679150:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784584667.679175:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568955520 00000100:00100000:1.0:1784584667.679178:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568955520 00000100:00100000:1.0:1784584667.679202:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784584667.679208:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:3320:x1871272568955520:12345-0@lo:400: 00000100:00100000:1.0:1784584667.679240:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:3320:x1871272568955520:12345-0@lo:400: Request processed in 32us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584667.679246:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784584667.679970:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568955520:0@lo:400: 00010000:00080000:1.0:1784584667.680013:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8010bfb80 x1871272568955648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584683 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584667.680040:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272568955648:0@lo:400: 00010000:00010000:1.0:1784584668.453092:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784584668.456574:0:6971:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1784584668.700173:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784584668.700180:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7d687f000 from 21 10000000:01000000:3.0:1784584668.700187:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784584668.700355:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584668.700368:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584668.700378:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584668.700400:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568955904:0@lo:101: 00000100:00100000:3.0:1784584668.700465:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584668.700577:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584668.705009:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568955904 00000100:00100000:1.0:1784584668.705022:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568955904 00000100:00100000:1.0:1784584668.705082:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784584668.705096:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568955904:12345-0@lo:101: 00010000:00010000:1.0:1784584668.705112:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584668.705130:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0e04 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.705157:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0e04 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.705168:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e04 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.705178:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c166e400, rc 0) 00000100:00100000:1.0:1784584668.707060:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568955904:12345-0@lo:101: Request processed in 1961us (6588us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584668.707072:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784584668.707124:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568955904:0@lo:101: 00010000:00010000:3.0:1784584668.707149:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584668.707162:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584668.707232:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956032:0@lo:501: 00000100:00100000:3.0:1784584668.707265:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584668.707308:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e923c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584668.707489:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568956032 00000100:00100000:1.0:1784584668.707495:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568956032 00000100:00100000:1.0:1784584668.707539:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784584668.707547:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568956032:12345-0@lo:501: 00000100:00100000:1.0:1784584668.708475:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568956032:12345-0@lo:501: Request processed in 926us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584668.708484:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784584668.708540:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956032:0@lo:501: 00000100:00100000:1.0:1784584668.708580:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956160:0@lo:503: 00000100:00100000:1.0:1784584668.708621:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584668.708684:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d87989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584668.712126:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568956160 00000100:00100000:2.0:1784584668.712141:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568956160 00000100:00100000:2.0:1784584668.712214:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1784584668.712225:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568956160:12345-0@lo:503: 00000100:00100000:2.0:1784584668.712687:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568956160:12345-0@lo:503: Request processed in 462us (4063us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584668.712738:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784584668.713509:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956160:0@lo:503: 00000100:00100000:1.0:1784584668.713977:0:6989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6989:1871272568956288:0@lo:502: 00000100:00100000:1.0:1784584668.714030:0:6989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584668.714096:0:6989:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584668.714188:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568956288 00000100:00100000:2.0:1784584668.714202:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568956288 00000100:00100000:2.0:1784584668.714278:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784584668.714287:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:6989:x1871272568956288:12345-0@lo:502: 00000100:00100000:2.0:1784584668.714586:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:6989:x1871272568956288:12345-0@lo:502: Request processed in 300us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584668.714595:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784584668.715866:0:6989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6989:1871272568956288:0@lo:502: 00000100:00100000:0.0:1784584668.715933:0:6989:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6989:1871272568956416:0@lo:502: 00000100:00100000:0.0:1784584668.715990:0:6989:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584668.716102:0:6989:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c656b000 going to sleep for 11 seconds 00000100:00100000:1.0:1784584668.716182:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568956416 00000100:00100000:1.0:1784584668.716189:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568956416 00000100:00100000:1.0:1784584668.716463:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784584668.716473:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:6989:x1871272568956416:12345-0@lo:502: 00000100:00100000:1.0:1784584668.716897:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:6989:x1871272568956416:12345-0@lo:502: Request processed in 424us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584668.716906:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784584668.717768:0:6989:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6989:1871272568956416:0@lo:502: 00000040:00080000:0.0:1784584668.717803:0:6989:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1784584668.718168:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1784584668.718190:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584668.718200:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.718210:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584668.718219:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784584668.718222:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97c7d687f000 from 4 10000000:01000000:1.0:1784584668.718225:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584668.718258:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.718274:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.718350:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584668.718371:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956544:0@lo:101: 00000100:00100000:1.0:1784584668.718485:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584668.718517:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798540 going to sleep for 11 seconds 00000100:00100000:2.0:1784584668.718623:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568956544 00000100:00100000:2.0:1784584668.718629:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568956544 00000100:00100000:2.0:1784584668.718674:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784584668.718683:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568956544:12345-0@lo:101: 00010000:00010000:2.0:1784584668.718714:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584668.718727:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0e12 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584668.718750:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0e12 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584668.718760:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e12 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584668.718768:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fce00, rc 0) 00000100:00100000:2.0:1784584668.718815:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568956544:12345-0@lo:101: Request processed in 133us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584668.718831:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784584668.718908:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956544:0@lo:101: 00010000:00010000:1.0:1784584668.718922:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.718931:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584668.718975:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956672:0@lo:256: 00000100:00100000:1.0:1784584668.719004:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584668.719029:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798540 going to sleep for 11 seconds 00000100:00100000:1.0:1784584668.719042:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568956672 00000100:00100000:1.0:1784584668.719045:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568956672 00000100:00100000:1.0:1784584668.719074:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784584668.719080:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568956672:12345-0@lo:256: 20000000:01000000:1.0:1784584668.719092:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784584668.719109:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784584668.719112:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1784584668.719183:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568956672:12345-0@lo:256: Request processed in 102us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584668.719194:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784584668.719230:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956672:0@lo:256: 10000000:01000000:1.0:1784584668.719264:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584668.719271:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.719278:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584668.719895:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784584668.719899:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1784584668.719903:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784584668.719926:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.719934:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.719943:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584668.719957:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956800:0@lo:101: 00000100:00100000:1.0:1784584668.719996:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584668.720102:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798540 going to sleep for 11 seconds 00000100:00100000:0.0:1784584668.723098:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568956800 00000100:00100000:0.0:1784584668.723111:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568956800 00000100:00100000:0.0:1784584668.723172:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784584668.723181:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568956800:12345-0@lo:101: 00010000:00010000:0.0:1784584668.723196:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584668.723455:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0e20 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584668.723494:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0e20 expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584668.723506:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e20 expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584668.723515:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c0031800, rc 0) 00000100:00100000:0.0:1784584668.723595:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568956800:12345-0@lo:101: Request processed in 415us (3598us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584668.723601:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784584668.725781:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956800:0@lo:101: 00010000:00010000:3.0:1784584668.725806:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584668.725818:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584668.725884:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956928:0@lo:501: 00000100:00100000:3.0:1784584668.725933:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584668.725967:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584668.726135:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568956928 00000100:00100000:2.0:1784584668.726141:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568956928 00000100:00100000:2.0:1784584668.726192:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784584668.726200:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568956928:12345-0@lo:501: 00000100:00100000:2.0:1784584668.726474:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568956928:12345-0@lo:501: Request processed in 265us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584668.726482:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1784584668.726648:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568956928:0@lo:501: 00000100:00100000:3.0:1784584668.726678:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568957056:0@lo:503: 00000100:00100000:3.0:1784584668.726755:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584668.726776:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e923c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584668.726975:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568957056 00000100:00100000:2.0:1784584668.726980:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568957056 00000100:00100000:2.0:1784584668.727011:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784584668.727017:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568957056:12345-0@lo:503: 00000100:00100000:2.0:1784584668.727294:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568957056:12345-0@lo:503: Request processed in 276us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584668.727301:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784584668.727403:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568957056:0@lo:503: 00000100:00100000:0.0:1784584668.732003:0:6991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6991:1871272568957184:0@lo:502: 00000100:00100000:0.0:1784584668.732075:0:6991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584668.732118:0:6991:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c656b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584668.732177:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568957184 00000100:00100000:1.0:1784584668.732183:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568957184 00000100:00100000:1.0:1784584668.732222:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784584668.732229:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:6991:x1871272568957184:12345-0@lo:502: 00000100:00100000:1.0:1784584668.732607:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:6991:x1871272568957184:12345-0@lo:502: Request processed in 377us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584668.732614:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1784584668.732728:0:6991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6991:1871272568957184:0@lo:502: 00000020:01000000:0.0:1784584668.732763:0:6991:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784584668.732771:0:6991:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784584668.732776:0:6991:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584668.732779:0:6991:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784584668.732783:0:6991:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784584668.732787:0:6991:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:0.0:1784584668.732808:0:6991:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784584668.732810:0:6991:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584668.732824:0:6991:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97c801b219c0) 00000020:00000080:0.0:1784584668.732842:0:6991:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1784584668.732848:0:6991:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784584668.732911:0:6991:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784584668.732917:0:6991:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784584668.732924:0:6991:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff0e35 00010000:00080000:0.0:1784584668.732950:0:6991:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7f3d4f800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1784584668.733158:0:6991:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1784584668.806438:0:6991:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1784584668.806518:0:6991:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784584668.807397:0:6991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784584668.807573:0:6991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784584668.807619:0:6991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1784584668.807677:0:6991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1784584668.811723:0:6995:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784584668.811733:0:6995:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784584668.815962:0:6991:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784584668.816051:0:6991:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784584668.816090:0:6991:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784584668.816113:0:6991:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff0e3c 00000100:00080000:1.0:1784584668.816124:0:6991:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784584668.816131:0:6991:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97c7f3d4f800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1784584668.816165:0:6991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c801b1f800 x1871272568957312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584668.816229:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272568957312:0@lo:8: 00000100:00100000:3.0:1784584668.816309:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784584668.816373:0:6991:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1784584668.816437:0:6991:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584668.816442:0:6991:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584668.816444:0:6991:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784584668.816446:0:6991:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584668.816450:0:6991:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584668.816451:0:6991:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784584668.816454:0:6991:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784584668.816456:0:6991:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1784584668.816488:0:6991:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6991:1871272568957440:0@lo:502: 00000100:00100000:1.0:1784584668.816536:0:6991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584668.816571:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568957440 00000100:00100000:1.0:1784584668.816577:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568957440 00000100:00100000:1.0:1784584668.816612:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784584668.816627:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+15:6991:x1871272568957440:12345-0@lo:502: 00000100:00100000:0.0:1784584668.816774:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568957568:0@lo:400: 00000100:00100000:0.0:1784584668.816931:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584668.816993:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568957568 00000100:00100000:0.0:1784584668.816997:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568957568 00000100:00100000:1.0:1784584668.817007:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+15:6991:x1871272568957440:12345-0@lo:502: Request processed in 380us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584668.817016:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784584668.817032:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584668.817041:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568957568:12345-0@lo:400: 00000100:00100000:1.0:1784584668.817068:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568957696:0@lo:400: 00000100:00100000:0.0:1784584668.817083:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568957568:12345-0@lo:400: Request processed in 43us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584668.817103:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584668.817104:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584668.817124:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568957696 00000100:00100000:0.0:1784584668.817128:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568957696 00000100:00100000:0.0:1784584668.817148:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584668.817154:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784584668.817156:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568957696:12345-0@lo:400: 00000100:00100000:1.0:1784584668.817165:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1784584668.817199:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568957696:12345-0@lo:400: Request processed in 44us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584668.817207:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784584668.817240:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0d180 x1871272568957568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584668.817253:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568957568:0@lo:400: 00010000:00080000:1.0:1784584668.817264:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0df80 x1871272568957696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584668.817276:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568957696:0@lo:400: 00000100:00100000:1.0:1784584668.817300:0:6991:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcfd300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584668.817310:0:6991:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:6991:1871272568957440:0@lo:502: 00000020:01000000:1.0:1784584668.817342:0:6991:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584668.817347:0:6991:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584668.817348:0:6991:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:1.0:1784584668.817352:0:6991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1784584668.817399:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1784584668.817416:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784584668.817425:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.817436:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584668.817444:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784584668.817446:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97c7c5d4b380 from 1 10000000:01000000:1.0:1784584668.817449:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784584668.817475:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.817484:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584668.817493:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584668.817504:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568957824:0@lo:101: 00000100:00100000:1.0:1784584668.817529:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584668.817555:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f3c239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584668.818309:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568957824 00000100:00100000:0.0:1784584668.818325:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568957824 00000100:00100000:0.0:1784584668.818361:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784584668.818369:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568957824:12345-0@lo:101: 00010000:00010000:0.0:1784584668.818380:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584668.818393:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0e43 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584668.818414:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0e43 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584668.818426:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e43 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584668.818436:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c0030600, rc 0) 00000100:00100000:0.0:1784584668.818493:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568957824:12345-0@lo:101: Request processed in 125us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584668.818507:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784584668.818585:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568957824:0@lo:101: 00010000:00010000:3.0:1784584668.818599:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584668.818609:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584668.818672:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568957952:0@lo:501: 00000100:00100000:3.0:1784584668.818720:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584668.818754:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f57ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1784584668.818945:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568957952 00000100:00100000:0.0:1784584668.818949:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568957952 00000100:00100000:0.0:1784584668.818972:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1784584668.818979:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568957952:12345-0@lo:501: 00000100:00100000:0.0:1784584668.819182:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568957952:12345-0@lo:501: Request processed in 202us (461us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784584668.819190:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784584668.820163:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568957952:0@lo:501: 10000000:01000000:3.0:1784584668.820203:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784584668.820212:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584668.820222:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584668.822198:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568957312 00000100:00100000:0.0:1784584668.822210:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568957312 00000100:00100000:0.0:1784584668.822260:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584668.822268:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3319:x1871272568957312:12345-0@lo:8: 00010000:00080000:0.0:1784584668.822296:0:6605:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:0.0:1784584668.822336:0:6605:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff0e51 00002000:00100000:0.0:1784584668.822375:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97c7f3d4b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1784584668.822380:0:6605:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1784584668.822384:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1784584668.822510:0:6605:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1784584668.822641:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784584668.822665:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7f3d4d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584668.822934:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1871272568957312:12345-0@lo:8: Request processed in 664us (6623us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584668.822941:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1784584668.824005:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b1f800 x1871272568957312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584668.824017:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784584668.824026:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1784584668.824034:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1784584668.824040:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1784584668.824042:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7f3d4f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1784584668.824065:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1784584668.824071:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272568957312:0@lo:8: 00000004:00080000:3.0:1784584668.824306:0:6995:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784584668.824410:0:6995:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 163931716630ns, next at 0ns, rc = 0 00000004:00080000:2.0:1784584668.878186:0:6996:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1784584668.878219:0:6996:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6996:1871272568958208:0@lo:7: 00000100:00100000:2.0:1784584668.878291:0:6996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584668.878344:0:6996:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d867fcc0 going to sleep for 11 seconds 00000004:00080000:2.0:1784584668.878370:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1784584668.878390:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584668.878401:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568958080:0@lo:13: 00000100:00100000:2.0:1784584668.878428:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584668.878457:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568958208 00000100:00100000:2.0:1784584668.878463:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568958208 00000100:00100000:2.0:1784584668.878511:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584668.878520:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6996:x1871272568958208:12345-0@lo:7: 00000100:00100000:3.0:1784584668.881853:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568958080 00000100:00100000:3.0:1784584668.881866:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568958080 00000100:00100000:3.0:1784584668.881929:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584668.881940:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1871272568958080:12345-0@lo:13: 00002000:00000024:3.0:1784584668.881974:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1784584668.882066:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1871272568958080:12345-0@lo:13: Request processed in 128us (3637us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584668.882075:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1784584668.882958:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1784584668.890401:0:6608:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1784584668.890410:0:6608:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784584668.890501:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6996:x1871272568958208:12345-0@lo:7: Request processed in 11978us (12206us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584668.890519:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784584668.890588:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c7c40f6680 x1871272568958080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584684 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584668.890611:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568958080:0@lo:13: 00010000:00080000:3.0:1784584668.890769:0:6996:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c7c40f7b80 x1871272568958208/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784584684 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584668.890791:0:6996:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6996:1871272568958208:0@lo:7: 00000004:00080000:3.0:1784584668.890801:0:6996:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784584668.890848:0:6996:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6996:1871272568958336:0@lo:5: 00000100:00100000:3.0:1784584668.890883:0:6996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584668.890916:0:6996:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f57ef000 going to sleep for 11 seconds 00000100:00100000:2.0:1784584668.891556:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568958336 00000100:00100000:2.0:1784584668.891564:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568958336 00000100:00100000:2.0:1784584668.891612:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584668.891621:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6996:x1871272568958336:12345-0@lo:5: 00002000:00080000:2.0:1784584668.891646:0:6607:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1784584668.891649:0:6607:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1784584668.892088:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6996:x1871272568958336:12345-0@lo:5: Request processed in 467us (1203us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1784584668.892095:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784584668.896054:0:6996:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8010bd880 x1871272568958336/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584684 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584668.896075:0:6996:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6996:1871272568958336:0@lo:5: 00000004:00080000:0.0:1784584668.896105:0:6996:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784584668.897084:0:6996:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6996:1871272568958464:0@lo:700: 00000100:00100000:1.0:1784584668.897136:0:6996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584668.897212:0:6996:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f3c23cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584668.898219:0:6614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568958464 00000100:00100000:3.0:1784584668.898229:0:6614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568958464 00000100:00100000:3.0:1784584668.898343:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584668.898353:0:6614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6996:x1871272568958464:12345-0@lo:700: 00000100:00100000:3.0:1784584668.898399:0:6614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6614:1871272568958592:0@lo:700: 00000100:00100000:3.0:1784584668.898446:0:6614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584668.898475:0:6614:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f57ef0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584668.898539:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568958592 00000100:00100000:0.0:1784584668.898543:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568958592 00000100:00100000:0.0:1784584668.898575:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584668.898582:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6614:x1871272568958592:12345-0@lo:700: 40000000:02000000:0.0:1784584668.965793:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1784584668.973190:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6614:x1871272568958592:12345-0@lo:700: Request processed in 74602us (74736us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584668.973212:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784584668.979475:0:6614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8010bf480 x1871272568958592/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784584684 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584668.979494:0:6614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6614:1871272568958592:0@lo:700: 40000000:02000000:2.0:1784584668.979507:0:6614:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:0.0:1784584669.065714:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784584669.065736:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1784584669.066092:0:6614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6996:x1871272568958464:12345-0@lo:700: Request processed in 167736us (168950us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584669.066104:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1784584669.066189:0:6996:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b1f800 x1871272568958464/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784584684 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584669.066201:0:6996:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784584669.066218:0:6996:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6996:1871272568958464:0@lo:700: 00000004:02000040:0.0:1784584669.108140:0:6996:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1784584669.114174:0:6996:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6996:1871272568958720:0@lo:5: 00000100:00100000:0.0:1784584669.114241:0:6996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584669.114352:0:6996:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4246c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584669.114393:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568958720 00000100:00100000:2.0:1784584669.114400:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568958720 00000100:00100000:2.0:1784584669.114481:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584669.114490:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6996:x1871272568958720:12345-0@lo:5: 00002000:00080000:0.0:1784584669.120562:0:6608:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1784584669.120583:0:6608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1784584669.124571:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6996:x1871272568958720:12345-0@lo:5: Request processed in 10077us (10324us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1784584669.124582:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784584669.124785:0:6996:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0d180 x1871272568958720/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584685 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584669.124800:0:6996:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6996:1871272568958720:0@lo:5: 00000004:00080000:2.0:1784584669.124814:0:6996:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1784584669.467813:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584670.491876:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584671.519010:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584672.544072:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784584672.976155:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1784584673.565108:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584673.820904:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568958976:0@lo:400: 00000100:00100000:0.0:1784584673.820968:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584673.821018:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584673.821024:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568958848:0@lo:400: 00000100:00100000:0.0:1784584673.821054:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584673.821087:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568958848 00000100:00100000:0.0:1784584673.821094:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568958848 00000100:00100000:0.0:1784584673.821132:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784584673.821141:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+16:3323:x1871272568958848:12345-0@lo:400: 00000100:00100000:0.0:1784584673.821187:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+16:3323:x1871272568958848:12345-0@lo:400: Request processed in 47us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584673.821195:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784584673.821240:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568958848:0@lo:400: 00000100:00100000:2.0:1784584673.821315:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568959104:0@lo:400: 00000100:00100000:2.0:1784584673.821346:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584673.821370:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584673.821376:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568959232:0@lo:400: 00000100:00100000:2.0:1784584673.821402:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584673.821576:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568958976 00000100:00100000:0.0:1784584673.821581:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568958976 00000100:00100000:0.0:1784584673.821616:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568959104 00000100:00100000:0.0:1784584673.821619:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568959104 00000100:00100000:0.0:1784584673.821647:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584673.821654:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568958976:12345-0@lo:400: 00000100:00100000:0.0:1784584673.821713:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568958976:12345-0@lo:400: Request processed in 37us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584673.821720:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784584673.821733:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784584673.821739:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568959104:12345-0@lo:400: 00000100:00100000:0.0:1784584673.821769:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568959104:12345-0@lo:400: Request processed in 30us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584673.821775:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1784584673.821869:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0dc00 x1871272568958976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584673.821882:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568958976:0@lo:400: 00010000:00080000:2.0:1784584673.821955:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0d500 x1871272568959104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584673.821966:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568959104:0@lo:400: 00000100:00080000:1.0:1784584673.822028:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584673.822316:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568959232 00000100:00100000:3.0:1784584673.822321:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568959232 00000100:00100000:3.0:1784584673.822367:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584673.822374:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568959232:12345-0@lo:400: 00000100:00100000:3.0:1784584673.822419:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568959232:12345-0@lo:400: Request processed in 45us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584673.822425:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1784584673.822458:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0ed80 x1871272568959232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584689 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584673.822465:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784584673.822475:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568959232:0@lo:400: 00000100:00080000:1.0:1784584673.822607:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584674.331957:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568959360:0@lo:13: 00000100:00100000:0.0:1784584674.332029:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584674.332162:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568959360 00000100:00100000:2.0:1784584674.332171:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568959360 00000100:00100000:2.0:1784584674.332219:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584674.332228:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568959360:12345-0@lo:13: 00002000:00000024:2.0:1784584674.332263:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584674.332325:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568959360:12345-0@lo:13: Request processed in 98us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584674.332332:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784584674.332414:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c7c40f7b80 x1871272568959360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584690 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584674.332433:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568959360:0@lo:13: 00010000:00010000:1.0:1784584674.587843:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584675.612517:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584676.637916:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584677.661535:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784584677.711077:0:7495:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1784584677.711086:0:7495:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1784584677.711225:0:7495:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97c7fceca000 00000020:01000004:3.0:1784584677.711240:0:7495:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1784584677.711253:0:7495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784584677.711278:0:7495:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97c7c7f8cd40) 00000020:00000080:3.0:1784584677.711295:0:7495:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784584677.747327:0:7495:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784584677.750113:0:7495:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1784584677.794428:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1784584677.810412:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784584677.810447:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1784584677.810518:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784584677.810544:0:7495:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1784584677.811081:0:7495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1784584677.811093:0:7495:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784584677.811103:0:7495:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x787d778cc3ff0e5f 00000020:01000004:3.0:1784584677.811110:0:7495:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1784584677.811131:0:7495:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784584677.811134:0:7495:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784584677.811140:0:7495:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1784584677.811159:0:7495:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1784584677.811163:0:7495:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1784584677.846476:0:7495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784584677.846515:0:7495:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1784584677.846520:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784584677.846521:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584677.846523:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584677.846524:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584677.846525:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584677.846526:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584677.846528:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584677.846529:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784584677.846531:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784584677.846533:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584677.846534:0:7495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584677.846538:0:7495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1784584677.846541:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584677.846542:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584677.846543:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584677.846544:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584677.846549:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584677.846550:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584677.846551:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584677.846552:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784584677.846553:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784584677.846554:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584677.846555:0:7495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584677.846581:0:7495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784584677.846599:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568959488:0@lo:253: 00000100:00100000:1.0:1784584677.846663:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584677.846769:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568959488 00000100:00100000:0.0:1784584677.846786:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568959488 00000100:00100000:0.0:1784584677.846841:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784584677.846851:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+16:7495:x1871272568959488:12345-0@lo:253: 00000100:00100000:1.0:1784584677.846878:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d867f900 going to sleep for 11 seconds 20000000:01000000:0.0:1784584677.846879:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784584677.846883:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1784584677.846887:0:5798:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1784584677.846890:0:5798:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1784584677.847734:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584677.847897:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1784584677.847911:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1784584677.847950:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1784584677.847958:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1784584677.847997:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1784584677.848055:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1784584677.848393:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1784584677.848410:0:5798:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:0.0:1784584677.848412:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:0.0:1784584677.848453:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1784584677.848466:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1784584677.848511:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1784584677.848519:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:0.0:1784584677.848549:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1784584677.848557:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1784584677.848581:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1784584677.848622:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1784584677.849442:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1784584677.849460:0:5798:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.152@tcp 20000000:01000000:1.0:1784584677.849462:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.152@tcp (null) (null) (null) 00000040:00080000:1.0:1784584677.849492:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1784584677.849500:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1784584677.849531:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1784584677.849550:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.152@tcp (null) (null) 00000040:00080000:1.0:1784584677.849582:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1784584677.849590:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784584677.849628:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1784584677.849667:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1784584677.851397:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1784584677.851403:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1784584677.851408:0:5798:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1784584677.851424:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784584677.851427:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1784584677.851479:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1784584677.851482:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784584677.852673:0:7497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1784584677.852819:0:7497:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1784584677.852856:0:7497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1784584677.853156:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1784584677.853188:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1784584677.853273:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1784584677.853294:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784584677.853296:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784584677.854123:0:7498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1784584677.854185:0:7498:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1784584677.854238:0:7498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1784584677.854508:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1784584677.854548:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1784584677.854578:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1784584677.854589:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1784584677.854599:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784584677.856179:0:7499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1784584677.856463:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1784584677.856507:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1784584677.856595:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1784584677.856610:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784584677.856612:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1784584677.857988:0:7500:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1784584677.858054:0:7500:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1784584677.858102:0:7500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1784584677.858491:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1784584677.858555:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1784584677.858615:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1784584677.858633:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1784584677.858636:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1784584677.858644:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784584677.858663:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.858933:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0db0 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.858942:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0dda expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.858949:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e04 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.858956:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e20 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.858962:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e43 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.858970:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.859021:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0e43 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.859035:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0e43 expref: 16 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584677.859049:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568959616:0@lo:104: 00000100:00100000:2.0:1784584677.859106:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584677.859188:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0e20 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.859197:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0e20 expref: 16 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584677.859205:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568959744:0@lo:104: 00010000:00010000:2.0:1784584677.859226:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0e04 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.859234:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0e04 expref: 16 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584677.859242:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568959872:0@lo:104: 00010000:00010000:2.0:1784584677.859282:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0dda expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.859291:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0dda expref: 16 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584677.859300:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568960000:0@lo:104: 00010000:00010000:2.0:1784584677.859331:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0db0 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.859339:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0db0 expref: 16 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584677.859347:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568960128:0@lo:104: 00000100:00100000:2.0:1784584677.859364:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584677.859419:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784584677.859441:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.859466:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.859473:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.859481:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.859493:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568959616 00000100:00100000:1.0:1784584677.859500:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568959616 00000100:00100000:0.0:1784584677.859514:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568959744 00000100:00100000:0.0:1784584677.859518:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568959744 00000100:00100000:1.0:1784584677.859531:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568960000 00000100:00100000:0.0:1784584677.859531:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568959872 00000100:00100000:1.0:1784584677.859533:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568960000 00000100:00100000:0.0:1784584677.859533:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568959872 00000100:00100000:0.0:1784584677.859541:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568960128 00000100:00100000:0.0:1784584677.859543:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568960128 00000100:00100000:1.0:1784584677.859547:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584677.859554:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+7:5798:x1871272568959616:12345-0@lo:104: 00010000:00010000:1.0:1784584677.859572:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.859673:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784584677.859686:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+7:5798:x1871272568959616:12345-0@lo:104: Request processed in 133us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584677.859714:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584677.859753:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784584677.859760:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+6:5798:x1871272568959744:12345-0@lo:104: 00010000:00010000:0.0:1784584677.859764:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584677.859768:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.859770:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.859793:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166f600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584677.859798:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.859806:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1784584677.859807:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.859811:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+6:5798:x1871272568959744:12345-0@lo:104: Request processed in 52us (370us total) trans 0 rc 0/0 10000000:00010000:0.0:1784584677.859814:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.859817:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 10000000:01000000:0.0:1784584677.859820:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1784584677.859831:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784584677.859837:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+5:5798:x1871272568959872:12345-0@lo:104: 00010000:00010000:1.0:1784584677.859843:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.859851:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.859856:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584677.859867:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784584677.859871:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+5:5798:x1871272568959872:12345-0@lo:104: Request processed in 35us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584677.859876:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1784584677.859881:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.859887:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1784584677.859888:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0e43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e4a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.859893:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+4:5798:x1871272568960000:12345-0@lo:104: 00010000:00010000:1.0:1784584677.859905:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.859912:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584677.859915:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.859921:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166e000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584677.859923:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.859930:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1784584677.859930:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.859935:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+4:5798:x1871272568960000:12345-0@lo:104: Request processed in 42us (460us total) trans 0 rc 0/0 10000000:00010000:0.0:1784584677.859937:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.859940:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 10000000:01000000:0.0:1784584677.859942:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1784584677.859951:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1784584677.859955:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.859957:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:5798:x1871272568960128:12345-0@lo:104: 00010000:00010000:0.0:1784584677.859960:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584677.859962:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.859974:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.859980:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0e20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e27 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.859984:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784584677.859988:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:5798:x1871272568960128:12345-0@lo:104: Request processed in 32us (506us total) trans 0 rc 0/0 00010000:00010000:0.0:1784584677.859989:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1784584677.859994:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1784584677.859997:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860003:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c1512c00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584677.860005:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860012:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584677.860018:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.860022:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:01000000:0.0:1784584677.860023:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1784584677.860032:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568960256:0@lo:103: 00010000:00010000:0.0:1784584677.860036:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860041:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584677.860045:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860052:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c1512c00/0x787d778cc3ff0e04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e0b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.860056:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784584677.860062:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584677.860065:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860070:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fde00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584677.860073:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860089:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584677.860095:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.860096:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568960256 00000100:00100000:1.0:1784584677.860099:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568960256 10000000:01000000:0.0:1784584677.860100:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784584677.860114:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e43 expref: 17 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860115:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860121:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584677.860130:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.860134:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1784584677.860137:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0dda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0de1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.860140:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+17:3322:x1871272568960256:12345-0@lo:103: 00010000:00010000:0.0:1784584677.860148:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584677.860149:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584677.860151:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.860154:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e43 expref: 17 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860157:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166e800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584677.860159:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860166:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.860169:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0e43 expref: 17 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584677.860173:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584677.860182:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784584677.860184:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584677.860193:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.860198:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584677.860203:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.860205:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+17:3322:x1871272568960256:12345-0@lo:103: Request processed in 66us (149us total) trans 0 rc 0/0 00010000:00010000:0.0:1784584677.860210:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0db0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0db7 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.860211:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1784584677.860221:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584677.860223:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584677.860225:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584677.860234:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568960384:0@lo:103: 00000100:00100000:1.0:1784584677.860238:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568960512:0@lo:103: 00000100:00100000:1.0:1784584677.860271:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584677.860274:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568960768:0@lo:103: 00000100:00100000:0.0:1784584677.860297:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.860312:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568960512 00000100:00100000:0.0:1784584677.860312:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784584677.860316:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568960512 00000100:00100000:0.0:1784584677.860317:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568960640:0@lo:103: 00010000:00010000:1.0:1784584677.860328:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e04 expref: 17 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584677.860335:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584677.860384:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584677.860529:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0e4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0e43 expref: 17 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584677.860542:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568959616:0@lo:104: 00000100:00100000:2.0:1784584677.860552:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568959744:0@lo:104: 00000100:00100000:2.0:1784584677.860558:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568959872:0@lo:104: 00000100:00100000:2.0:1784584677.860564:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568960000:0@lo:104: 00000100:00100000:2.0:1784584677.860570:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5798:1871272568960128:0@lo:104: 00010000:00010000:2.0:1784584677.860594:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584677.860772:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568960256:0@lo:103: 00000100:00100000:0.0:1784584677.866443:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.867429:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568960768 00000100:00100000:1.0:1784584677.867441:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568960768 00010000:00010000:1.0:1784584677.867491:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0db0 expref: 17 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.867516:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568960640 00000100:00100000:1.0:1784584677.867519:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568960640 00010000:00010000:1.0:1784584677.867530:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0dda expref: 18 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.867544:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784584677.867552:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+18:3321:x1871272568960512:12345-0@lo:103: 00010000:00010000:1.0:1784584677.867564:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584677.867570:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e04 expref: 18 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.867598:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0e04 expref: 18 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.867615:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0e0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0e04 expref: 18 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.867629:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584677.868354:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+17:3321:x1871272568960512:12345-0@lo:103: Request processed in 799us (8078us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584677.868364:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784584677.868417:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568960512:0@lo:103: 00000100:00100000:1.0:1784584677.868448:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784584677.868457:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+16:3323:x1871272568960768:12345-0@lo:103: 00010000:00010000:1.0:1784584677.868467:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584677.868473:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0db0 expref: 16 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.868484:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0db0 expref: 16 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.868497:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c0031000/0x787d778cc3ff0db7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0db0 expref: 16 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.868508:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584677.868547:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+15:3323:x1871272568960768:12345-0@lo:103: Request processed in 92us (8250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584677.868553:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784584677.868565:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584677.868579:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+14:3323:x1871272568960640:12345-0@lo:103: 00010000:00010000:1.0:1784584677.868588:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584677.868593:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0dda expref: 14 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.868601:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0dda expref: 14 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.868610:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1512e00/0x787d778cc3ff0de1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0dda expref: 14 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.868618:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584677.868642:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+13:3323:x1871272568960640:12345-0@lo:103: Request processed in 63us (8305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584677.868648:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584677.869004:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568960640:0@lo:103: 00000100:00100000:1.0:1784584677.869013:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568960768:0@lo:103: 00000100:00100000:1.0:1784584677.870649:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568960384 00000100:00100000:1.0:1784584677.870660:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568960384 00010000:00010000:1.0:1784584677.870721:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e20 expref: 13 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.870746:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784584677.870754:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+13:3320:x1871272568960384:12345-0@lo:103: 00010000:00010000:1.0:1784584677.870768:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584677.870781:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e20 expref: 13 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870809:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0e20 expref: 13 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870824:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c0031800/0x787d778cc3ff0e27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0e20 expref: 13 pid: 5800 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870840:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870847:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870862:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870868:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870875:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870883:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870888:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fca00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584677.870892:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870908:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870940:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.870950:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584677.870996:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+12:3320:x1871272568960384:12345-0@lo:103: Request processed in 243us (4561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584677.871003:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584677.871240:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568960384:0@lo:103: 00010000:00010000:0.0:1784584677.871276:0:5798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.871284:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.871300:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0e66 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784584677.871315:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1784584677.922569:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+11:7495:x1871272568959488:12345-0@lo:253: Request processed in 75711us (75896us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584677.922582:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784584677.922658:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568959488:0@lo:253: 10000000:01000000:1.0:1784584677.922672:0:7495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784584677.922676:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784584677.922678:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584677.922679:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584677.922680:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1784584677.922681:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584677.922683:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584677.922684:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584677.922686:0:7495:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784584677.922688:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584677.922925:0:7495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784584677.922949:0:7495:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c7fceca000 from lustre-OST0001 10000000:01000000:1.0:1784584677.922973:0:7495:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784584677.922976:0:7495:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784584677.922983:0:7495:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97c7c5d4b380 local copy 10000000:01000000:1.0:1784584677.922987:0:7495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784584677.923019:0:7495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.923030:0:7495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.923040:0:7495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.923069:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568960896:0@lo:101: 00000100:00100000:1.0:1784584677.923104:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.923179:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584677.923263:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568960896 00000100:00100000:0.0:1784584677.923270:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568960896 00000100:00100000:0.0:1784584677.923342:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784584677.923350:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+11:7495:x1871272568960896:12345-0@lo:101: 00010000:00010000:0.0:1784584677.923362:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584677.923376:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0e6d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.923398:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0e6d expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.923408:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e6d expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.923418:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c0031400, rc 0) 00000100:00100000:0.0:1784584677.923456:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568960896:12345-0@lo:101: Request processed in 107us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584677.923462:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784584677.923524:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568960896:0@lo:101: 00010000:00010000:1.0:1784584677.923537:0:7495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.923545:0:7495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.923625:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961024:0@lo:501: 00000100:00100000:1.0:1784584677.923648:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.923799:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584677.923920:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568961024 00000100:00100000:2.0:1784584677.923926:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568961024 00000100:00100000:2.0:1784584677.923948:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784584677.923953:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961024:12345-0@lo:501: 00000100:00100000:2.0:1784584677.924168:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961024:12345-0@lo:501: Request processed in 213us (517us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584677.924184:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784584677.924454:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961024:0@lo:501: 10000000:01000000:1.0:1784584677.924468:0:7495:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784584677.924497:0:7495:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784584677.924503:0:7495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.924512:0:7495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.924518:0:7495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.924542:0:7495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784584677.924572:0:7495:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c7fceca000 10000000:01000000:1.0:1784584677.924577:0:7495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784584677.924582:0:7495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784584677.924585:0:7495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584677.924589:0:7495:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784584677.924591:0:7495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784584677.924611:0:7495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.924617:0:7495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.924624:0:7495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.924637:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961152:0@lo:101: 00000100:00100000:1.0:1784584677.924664:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.924677:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00010000:00010000:2.0:1784584677.924748:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584677.924754:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.924761:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166e400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584677.924764:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.924772:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584677.924779:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584677.924891:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584677.924910:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.924915:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584677.924942:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.924949:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166e400/0x787d778cc3ff0e6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x787d778cc3ff0e74 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.924961:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584677.924963:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584677.924964:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584677.924971:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784584677.924988:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568961280:0@lo:103: 00000100:00100000:2.0:1784584677.925013:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584677.925047:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568961280 00000100:00100000:2.0:1784584677.925051:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568961280 00000100:00100000:2.0:1784584677.925085:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584677.925092:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+12:3321:x1871272568961280:12345-0@lo:103: 00010000:00010000:2.0:1784584677.925103:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584677.925116:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0e6d expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.925129:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584677.925157:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+11:3321:x1871272568961280:12345-0@lo:103: Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584677.925163:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584677.925189:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568961280:0@lo:103: 00000100:00100000:2.0:1784584677.925206:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568961152 00000100:00100000:2.0:1784584677.925210:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568961152 00000100:00100000:2.0:1784584677.925225:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784584677.925230:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+11:7495:x1871272568961152:12345-0@lo:101: 00010000:00010000:2.0:1784584677.925238:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584677.925248:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0e7b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.925278:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0e7b expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.925286:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e7b expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.925303:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fda00, rc 0) 00000100:00100000:2.0:1784584677.925330:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961152:12345-0@lo:101: Request processed in 99us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584677.925336:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784584677.925415:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961152:0@lo:101: 00010000:00010000:1.0:1784584677.925427:0:7495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.925436:0:7495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584677.925503:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961408:0@lo:501: 00000100:00100000:1.0:1784584677.925528:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.925546:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584677.925629:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568961408 00000100:00100000:2.0:1784584677.925633:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568961408 00000100:00100000:2.0:1784584677.925648:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784584677.925653:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961408:12345-0@lo:501: 00000100:00100000:2.0:1784584677.925866:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961408:12345-0@lo:501: Request processed in 211us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584677.925873:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784584677.926058:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961408:0@lo:501: 00000100:00100000:1.0:1784584677.926094:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961536:0@lo:503: 00000100:00100000:1.0:1784584677.926131:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.926155:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584677.926200:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568961536 00000100:00100000:2.0:1784584677.926204:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568961536 00000100:00100000:2.0:1784584677.926231:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784584677.926237:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961536:12345-0@lo:503: 00000100:00100000:2.0:1784584677.926375:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961536:12345-0@lo:503: Request processed in 138us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584677.926382:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784584677.926472:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961536:0@lo:503: 00000040:00080000:1.0:1784584677.926730:0:7495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784584677.926787:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961664:0@lo:502: 00000100:00100000:1.0:1784584677.926818:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.926838:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584677.927014:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568961664 00000100:00100000:2.0:1784584677.927018:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568961664 00000100:00100000:2.0:1784584677.927045:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784584677.927050:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961664:12345-0@lo:502: 00000100:00100000:2.0:1784584677.927167:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961664:12345-0@lo:502: Request processed in 116us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584677.927173:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784584677.927286:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961664:0@lo:502: 00000040:00080000:1.0:1784584677.927506:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784584677.927547:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784584677.927574:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784584677.927611:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784584677.927638:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784584677.927663:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784584677.927683:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961792:0@lo:502: 00000100:00100000:1.0:1784584677.927744:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.927758:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584677.927870:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568961792 00000100:00100000:2.0:1784584677.927880:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568961792 00000100:00100000:2.0:1784584677.927946:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784584677.927953:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961792:12345-0@lo:502: 00000100:00100000:2.0:1784584677.928070:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961792:12345-0@lo:502: Request processed in 117us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584677.928077:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784584677.928176:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961792:0@lo:502: 00000040:00080000:1.0:1784584677.928253:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1784584677.928275:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1784584677.928751:0:7502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784584677.928759:0:7502:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1784584677.928765:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584677.928768:0:7502:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1784584677.928773:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784584677.928794:0:7502:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97c7d8a78000) 00000020:00000080:1.0:1784584677.928820:0:7502:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1784584677.928826:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1784584677.928890:0:7502:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c7fceca000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1784584677.928897:0:7502:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784584677.928904:0:7502:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x787d778cc3ff0e90 00010000:00010000:1.0:1784584677.932083:0:7502:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1784584677.932377:0:7502:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1784584677.935126:0:7502:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1784584677.935409:0:7502:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1784584677.939378:0:7502:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1784584677.940123:0:7502:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1784584677.941303:0:7502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1784584677.941316:0:7502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584677.941328:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584677.941330:0:7502:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1784584677.941334:0:7502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584677.941339:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584677.941340:0:7502:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784584677.941343:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784584677.941345:0:7502:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784584677.941390:0:7502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584677.941393:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584677.941395:0:7502:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784584677.941398:0:7502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1784584677.941456:0:7495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1784584677.941477:0:7495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1784584677.941493:0:7495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.941506:0:7495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584677.941515:0:7495:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7fceca000 from 1 10000000:01000000:0.0:1784584677.941518:0:7495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784584677.941550:0:7495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.941558:0:7495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.941568:0:7495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584677.941590:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961920:0@lo:101: 00000100:00100000:0.0:1784584677.941653:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584677.941715:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e038e480 going to sleep for 11 seconds 00000100:00100000:0.0:1784584677.941737:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568961920 00000100:00100000:0.0:1784584677.941743:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568961920 00000100:00100000:0.0:1784584677.943596:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784584677.943620:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+12:7495:x1871272568961920:12345-0@lo:101: 00010000:00010000:0.0:1784584677.943638:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584677.943654:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0e97 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.943680:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0e97 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.943704:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e97 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.943714:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c0031400, rc 0) 00000100:00100000:0.0:1784584677.944921:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568961920:12345-0@lo:101: Request processed in 167us (2126us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584677.944932:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784584677.945005:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568961920:0@lo:101: 00010000:00010000:0.0:1784584677.945028:0:7495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584677.945039:0:7495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584677.945150:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962048:0@lo:501: 00000100:00100000:0.0:1784584677.945194:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584677.945238:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e038e480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584677.945390:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568962048 00000100:00100000:3.0:1784584677.945396:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568962048 00000100:00100000:3.0:1784584677.945439:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784584677.945448:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568962048:12345-0@lo:501: 00000100:00100000:3.0:1784584677.945673:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568962048:12345-0@lo:501: Request processed in 225us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584677.945681:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1784584677.945751:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962048:0@lo:501: 00000100:00100000:3.0:1784584677.945789:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962176:0@lo:503: 00000100:00100000:3.0:1784584677.945827:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584677.945847:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584677.945860:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568962176 00000100:00100000:3.0:1784584677.945864:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568962176 00000100:00100000:3.0:1784584677.945884:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784584677.945889:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568962176:12345-0@lo:503: 00000100:00100000:3.0:1784584677.946136:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568962176:12345-0@lo:503: Request processed in 245us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584677.946143:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784584677.946186:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962176:0@lo:503: 00000040:00080000:3.0:1784584677.946447:0:7495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784584677.946499:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962304:0@lo:502: 00000100:00100000:3.0:1784584677.946532:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584677.946547:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584677.946561:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568962304 00000100:00100000:3.0:1784584677.946564:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568962304 00000100:00100000:3.0:1784584677.946580:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784584677.946586:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568962304:12345-0@lo:502: 00000100:00100000:3.0:1784584677.946721:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568962304:12345-0@lo:502: Request processed in 134us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584677.946727:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784584677.946765:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962304:0@lo:502: 00000040:00080000:3.0:1784584677.946990:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1784584677.947036:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1784584677.947064:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962432:0@lo:502: 00000100:00100000:3.0:1784584677.947096:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584677.947108:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584677.947120:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568962432 00000100:00100000:3.0:1784584677.947124:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568962432 00000100:00100000:3.0:1784584677.947140:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784584677.947145:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568962432:12345-0@lo:502: 00000100:00100000:3.0:1784584677.947248:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568962432:12345-0@lo:502: Request processed in 102us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584677.947264:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1784584677.947303:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962432:0@lo:502: 00000040:00080000:3.0:1784584677.947372:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1784584677.947381:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1784584677.949964:0:7506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584677.949976:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584677.949979:0:7506:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784584677.949986:0:7506:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7fceca000 00000020:00000080:0.0:1784584677.949990:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584677.950011:0:7506:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584677.950014:0:7506:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584677.950015:0:7506:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1784584677.950018:0:7506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1784584677.950229:0:7495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1784584677.950264:0:7495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784584677.950285:0:7495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584677.950296:0:7495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584677.950340:0:7495:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1784584677.950343:0:7495:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c7fceca000 10000000:01000000:3.0:1784584677.950347:0:7495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c7fceca000 10000000:01000000:3.0:1784584677.950350:0:7495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784584677.950356:0:7495:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7fceca000 from 1 10000000:01000000:3.0:1784584677.950359:0:7495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784584677.950389:0:7495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584677.950410:0:7495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584677.950421:0:7495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584677.950444:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962560:0@lo:101: 00000100:00100000:3.0:1784584677.950504:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584677.950551:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584677.950607:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568962560 00000100:00100000:2.0:1784584677.950614:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568962560 00000100:00100000:2.0:1784584677.950659:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1784584677.950668:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568962560:12345-0@lo:101: 00010000:00010000:2.0:1784584677.950680:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584677.950715:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0ea5 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.950737:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0ea5 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.950748:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0ea5 expref: 14 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584677.950757:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fca00, rc 0) 00000100:00100000:2.0:1784584677.950937:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568962560:12345-0@lo:101: Request processed in 270us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584677.950945:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1784584677.951047:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962560:0@lo:101: 00010000:00010000:3.0:1784584677.951061:0:7495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584677.951070:0:7495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584677.951160:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962688:0@lo:501: 00000100:00100000:3.0:1784584677.951188:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584677.951215:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96300 going to sleep for 11 seconds 00000100:00100000:0.0:1784584677.951486:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568962688 00000100:00100000:0.0:1784584677.951491:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568962688 00000100:00100000:0.0:1784584677.951518:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784584677.951525:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568962688:12345-0@lo:501: 00000100:00100000:0.0:1784584677.951759:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568962688:12345-0@lo:501: Request processed in 234us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584677.951767:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1784584677.952097:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962688:0@lo:501: 00000100:00100000:1.0:1784584677.952144:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962816:0@lo:503: 00000100:00100000:1.0:1784584677.952186:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584677.952205:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568962816 00000100:00100000:2.0:1784584677.952209:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568962816 00000100:00100000:1.0:1784584677.952210:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798240 going to sleep for 11 seconds 00000100:00100000:2.0:1784584677.952243:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784584677.952251:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568962816:12345-0@lo:503: 00000100:00100000:2.0:1784584677.952399:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568962816:12345-0@lo:503: Request processed in 148us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584677.952411:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784584677.952457:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962816:0@lo:503: 00000040:00080000:2.0:1784584677.952888:0:7495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584677.952944:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962944:0@lo:502: 00000100:00100000:2.0:1784584677.952985:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584677.953004:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010da180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584677.953112:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568962944 00000100:00100000:3.0:1784584677.953117:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568962944 00000100:00100000:3.0:1784584677.953149:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784584677.953156:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568962944:12345-0@lo:502: 00000100:00100000:3.0:1784584677.953347:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568962944:12345-0@lo:502: Request processed in 190us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584677.953355:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784584677.954053:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568962944:0@lo:502: 00000040:00080000:1.0:1784584677.954277:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784584677.954334:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784584677.954375:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784584677.954428:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784584677.954466:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784584677.954513:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784584677.954561:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784584677.954594:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784584677.954664:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784584677.954732:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784584677.954771:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784584677.956272:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784584677.956325:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784584677.956363:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784584677.956413:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784584677.956468:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784584677.956501:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784584677.956541:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784584677.956577:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784584677.956612:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784584677.956662:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784584677.956721:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784584677.956771:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784584677.956899:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784584677.956943:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1784584677.957097:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1784584677.957271:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1784584677.957321:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1784584677.957355:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1784584677.957416:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1784584677.957456:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1784584677.957491:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1784584677.957525:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1784584677.957574:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1784584677.957608:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1784584677.957650:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1784584677.957686:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1784584677.957755:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568963072:0@lo:502: 00000100:00100000:1.0:1784584677.957898:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.958003:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584677.958131:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568963072 00000100:00100000:3.0:1784584677.958185:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568963072 00000100:00100000:3.0:1784584677.958227:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784584677.958237:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568963072:12345-0@lo:502: 00000100:00100000:3.0:1784584677.958632:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568963072:12345-0@lo:502: Request processed in 396us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584677.958638:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784584677.958758:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568963072:0@lo:502: 00000040:00080000:1.0:1784584677.958911:0:7495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1784584677.958923:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1784584677.960628:0:7507:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784584677.960643:0:7507:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97c7fbd019c0) 00000020:00000080:2.0:1784584677.960662:0:7507:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1784584677.961026:0:7507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c7fceca000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784584677.961031:0:7507:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c7fceca000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784584677.961034:0:7507:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7fceca000 3 00010000:00080000:2.0:1784584677.961062:0:7507:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7fcece800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1784584677.965876:0:7507:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1784584677.965978:0:7507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784584677.966015:0:7507:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784584677.966040:0:7507:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x787d778cc3ff0eba 00000100:00080000:2.0:1784584677.966050:0:7507:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584677.966056:0:7507:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97c7fcece800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1784584677.966097:0:7507:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7c40f4380 x1871272568963200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584677.966116:0:7507:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784584677.967360:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1871272568963200:0@lo:38: 00000100:00100000:1.0:1784584677.967441:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584677.967894:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568963200 00000100:00100000:0.0:1784584677.967912:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568963200 00000100:00100000:0.0:1784584677.967948:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584677.967955:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1871272568963200:12345-0@lo:38: 00010000:00080000:0.0:1784584677.967979:0:5807:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1784584677.968010:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x787d778cc3ff0ec1 00000004:00100000:0.0:1784584677.968025:0:5807:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784584677.968053:0:5807:0:(import.c:65:import_set_state_nolock()) ffff97c7d87ac000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584677.968107:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871272568963200:12345-0@lo:38: Request processed in 150us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584677.968114:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1784584677.968216:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c7c40f4380 x1871272568963200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584677.968237:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784584677.968244:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784584677.968251:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784584677.968266:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784584677.968268:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7fcece800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784584677.968273:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1871272568963200:0@lo:38: 00000100:00100000:0.0:1784584677.968297:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272568963328:0@lo:400: 00000100:00100000:0.0:1784584677.968326:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584677.968358:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272568963456:0@lo:400: 00000100:00100000:0.0:1784584677.968381:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584677.968398:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784584677.968404:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568963584:0@lo:400: 00000100:00100000:0.0:1784584677.968429:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.970611:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568963328 00000100:00100000:0.0:1784584677.970611:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568963456 00000100:00100000:1.0:1784584677.970623:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568963328 00000100:00100000:0.0:1784584677.970623:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568963456 00000100:00080000:2.0:1784584677.970707:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584677.971350:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584677.971364:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272568963328:12345-0@lo:400: 00000100:00100000:0.0:1784584677.971467:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272568963328:12345-0@lo:400: Request processed in 107us (3139us total) trans 0 rc 0/0 00010000:00080000:2.0:1784584677.971551:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0ca80 x1871272568963328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584677.971566:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272568963328:0@lo:400: 00000100:00100000:1.0:1784584677.971674:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584677.971685:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272568963456:12345-0@lo:400: 00000100:00100000:1.0:1784584677.971747:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272568963456:12345-0@lo:400: Request processed in 65us (3364us total) trans 0 rc 0/0 00010000:00080000:2.0:1784584677.971852:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0f100 x1871272568963456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584677.971862:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272568963456:0@lo:400: 00000100:00100000:0.0:1784584677.972067:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584677.972096:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568963584 00000100:00100000:0.0:1784584677.972101:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568963584 00000100:00100000:1.0:1784584677.972108:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584677.972191:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584677.972199:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568963584:12345-0@lo:400: 00000100:00100000:0.0:1784584677.972247:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568963584:12345-0@lo:400: Request processed in 49us (3816us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584677.972273:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784584677.972301:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0c380 x1871272568963584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584677.972311:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568963584:0@lo:400: 00000100:00080000:2.0:1784584677.972561:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1784584677.972990:0:7507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1784584677.973065:0:7495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1784584677.973090:0:7495:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584677.973108:0:7495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584677.973118:0:7495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1784584677.973232:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1784584677.973235:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584677.973236:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584677.973237:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584677.973238:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584677.973240:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584677.973241:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584677.973243:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784584677.973244:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784584677.973246:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584677.973247:0:7495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584677.973251:0:7495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1784584677.973262:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584677.973264:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784584677.973270:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584677.973271:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584677.973272:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584677.973273:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584677.973274:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784584677.973275:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1784584677.973276:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1784584677.973277:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584677.973278:0:7495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1784584677.973299:0:7495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784584677.973315:0:7495:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568963712:0@lo:253: 00000100:00100000:1.0:1784584677.973366:0:7495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584677.973408:0:7495:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798240 going to sleep for 11 seconds 00000100:00100000:2.0:1784584677.974312:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568963712 00000100:00100000:2.0:1784584677.974321:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568963712 00000100:00100000:2.0:1784584677.974372:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784584677.974380:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+14:7495:x1871272568963712:12345-0@lo:253: 20000000:01000000:2.0:1784584677.974405:0:5799:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784584677.974418:0:5799:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784584677.975640:0:7508:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7508:1871272568963840:0@lo:901: 00000100:00100000:0.0:1784584677.975725:0:7508:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584677.975752:0:7508:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e038e180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584677.976110:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568963840 00000100:00100000:1.0:1784584677.976116:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568963840 00000100:00100000:1.0:1784584677.976183:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584677.976192:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7508:x1871272568963840:12345-0@lo:901: 00000100:00100000:1.0:1784584677.976509:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7508:x1871272568963840:12345-0@lo:901: Request processed in 317us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584677.976516:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1784584677.976552:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784584677.976655:0:7508:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c801b0fb80 x1871272568963840/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1784584693 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584677.976669:0:7508:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7508:1871272568963840:0@lo:901: 20000000:01000000:0.0:1784584678.007200:0:5799:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784584678.007262:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784584678.007372:0:5822:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784584678.007377:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784584678.007399:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.007418:0:5822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e12 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.007425:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.007461:0:5822:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0e12 expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.007475:0:5822:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0e12 expref: 14 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584678.007489:0:5822:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5822:1871272568963968:0@lo:104: 00000100:00100000:3.0:1784584678.007551:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584678.008209:0:5822:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96900 going to sleep for 11 seconds 00000100:00100000:0.0:1784584678.008274:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568963968 00000100:00100000:0.0:1784584678.008281:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568963968 00000100:00100000:0.0:1784584678.009022:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584678.009033:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:5822:x1871272568963968:12345-0@lo:104: 00010000:00010000:0.0:1784584678.009045:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584678.009116:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584678.009122:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:5822:x1871272568963968:12345-0@lo:104: Request processed in 92us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584678.009128:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584678.009188:0:5822:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bdf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5822:1871272568963968:0@lo:104: 00010000:00010000:2.0:1784584678.009211:0:5822:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584678.009292:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584678.009299:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584678.009307:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166f400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584678.009310:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584678.009334:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584678.009340:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584678.009345:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784584678.009426:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584678.009433:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1784584678.009662:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568964096:0@lo:103: 00000100:00100000:1.0:1784584678.009746:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584678.009773:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568964096 00000100:00100000:3.0:1784584678.009785:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568964096 00010000:00010000:3.0:1784584678.009814:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e12 expref: 15 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584678.009850:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584678.009858:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+15:3320:x1871272568964096:12345-0@lo:103: 00010000:00010000:3.0:1784584678.009869:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584678.009874:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e12 expref: 15 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.009885:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0e12 expref: 15 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584678.010003:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584678.010011:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0e12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e19 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584678.010029:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584678.010031:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584678.010033:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584678.010121:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0e19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0e12 expref: 15 pid: 5798 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.010135:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.010143:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784584678.010157:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002780822s 00010000:00010000:3.0:1784584678.010162:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.010168:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.010175:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.010182:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.010193:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c1513200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584678.010197:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.010207:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.010225:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584678.010234:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584678.010299:0:5822:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584678.010307:0:5822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584678.010313:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0ec8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584678.010377:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f60450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+14:3320:x1871272568964096:12345-0@lo:103: Request processed in 518us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584678.010388:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784584678.010389:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568964096:0@lo:103: 00000100:00100000:1.0:1784584678.023431:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:7495:x1871272568963712:12345-0@lo:253: Request processed in 49040us (50053us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584678.023447:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784584678.023563:0:7495:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c4006421-7015-489e-aaaa-81e9219afdea:7495:1871272568963712:0@lo:253: 10000000:01000000:2.0:1784584678.023579:0:7495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784584678.023583:0:7495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584678.023600:0:7495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784584678.023601:0:7495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584678.023602:0:7495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584678.023604:0:7495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584678.023605:0:7495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584678.023606:0:7495:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784584678.023607:0:7495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784584678.023608:0:7495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784584678.023609:0:7495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584678.023611:0:7495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784584678.023629:0:7495:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784584678.030605:0:7495:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584678.031053:0:7495:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784584678.031273:0:7495:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584678.031444:0:7495:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784584678.031668:0:7495:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584678.032173:0:7495:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784584678.033213:0:7495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1784584678.232389:0:7495:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1784584678.232396:0:7495:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1784584678.232431:0:7495:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784584678.232488:0:7495:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784584678.232504:0:7495:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784584678.232540:0:7495:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1784584678.683924:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584679.452224:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568964224:0@lo:13: 00000100:00100000:0.0:1784584679.452310:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584679.452544:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568964224 00000100:00100000:3.0:1784584679.452562:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568964224 00000100:00100000:3.0:1784584679.452634:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584679.452644:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568964224:12345-0@lo:13: 00002000:00000024:3.0:1784584679.452676:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784584679.453136:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584679.454215:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568964224:12345-0@lo:13: Request processed in 1567us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584679.454242:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1784584679.455053:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7c40f5f80 x1871272568964224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584695 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584679.455076:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568964224:0@lo:13: 00010000:00010000:0.0:1784584679.708810:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584680.735208:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584681.761278:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584682.780493:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584683.035923:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568964480:0@lo:400: 00000100:00100000:0.0:1784584683.035986:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584683.036040:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784584683.036047:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568964352:0@lo:400: 00000100:00100000:0.0:1784584683.036075:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584683.036097:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568964864:0@lo:400: 00000100:00100000:0.0:1784584683.036117:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584683.036141:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568964608:0@lo:400: 00000100:00100000:0.0:1784584683.036182:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584683.036201:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584683.036206:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568964736:0@lo:400: 00000100:00100000:0.0:1784584683.036241:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584683.036273:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568964480 00000100:00100000:0.0:1784584683.036280:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568964480 00000100:00100000:0.0:1784584683.036315:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568964864 00000100:00100000:0.0:1784584683.036318:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568964864 00000100:00100000:0.0:1784584683.036338:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568964608 00000100:00100000:0.0:1784584683.036341:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568964608 00000100:00100000:0.0:1784584683.036357:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584683.036364:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568964480:12345-0@lo:400: 00000100:00100000:0.0:1784584683.036413:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568964480:12345-0@lo:400: Request processed in 49us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584683.036421:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584683.036436:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584683.036442:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568964864:12345-0@lo:400: 00000100:00100000:0.0:1784584683.036466:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568964864:12345-0@lo:400: Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584683.036478:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584683.036489:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584683.036495:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568964608:12345-0@lo:400: 00000100:00100000:0.0:1784584683.036522:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568964608:12345-0@lo:400: Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584683.036526:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584683.036544:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568964736 00000100:00100000:0.0:1784584683.036547:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568964736 00000100:00100000:0.0:1784584683.036570:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584683.036575:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568964736:12345-0@lo:400: 00000100:00100000:0.0:1784584683.036599:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568964736:12345-0@lo:400: Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584683.036604:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1784584683.036618:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784584683.036622:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784584683.036649:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b0fb80 x1871272568964736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584683.036664:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568964736:0@lo:400: 00010000:00080000:0.0:1784584683.036673:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b0df80 x1871272568964608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584683.036713:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568964608:0@lo:400: 00010000:00080000:0.0:1784584683.036741:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b0c380 x1871272568964864/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584683.036749:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568964864:0@lo:400: 00010000:00080000:0.0:1784584683.036757:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b0d500 x1871272568964480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584683.036770:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568964480:0@lo:400: 00000100:00100000:3.0:1784584683.036945:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568964352 00000100:00100000:3.0:1784584683.036950:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568964352 00000100:00100000:3.0:1784584683.036976:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784584683.036981:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:3323:x1871272568964352:12345-0@lo:400: 00000100:00100000:3.0:1784584683.037020:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:3323:x1871272568964352:12345-0@lo:400: Request processed in 39us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584683.037027:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1784584683.037065:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568964352:0@lo:400: 00010000:00010000:0.0:1784584683.812141:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784584684.464973:0:7850:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1784584684.575867:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568964992:0@lo:13: 00000100:00100000:3.0:1784584684.575937:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584684.576068:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568964992 00000100:00100000:0.0:1784584684.576077:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568964992 00000100:00100000:0.0:1784584684.576154:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584684.576163:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568964992:12345-0@lo:13: 00002000:00000024:0.0:1784584684.576193:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584684.576252:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568964992:12345-0@lo:13: Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584684.576259:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1784584684.576316:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7c40f4a80 x1871272568964992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584700 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584684.576334:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568964992:0@lo:13: 00010000:00010000:0.0:1784584684.829758:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584685.852337:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584686.876250:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784584687.645578:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1784584687.645586:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7c7f3c000 from 30 10000000:01000000:2.0:1784584687.645592:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784584687.645632:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584687.645644:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584687.645655:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584687.645678:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965120:0@lo:101: 00000100:00100000:2.0:1784584687.645758:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584687.647205:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dae40 going to sleep for 11 seconds 00000100:00100000:1.0:1784584687.647375:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568965120 00000100:00100000:1.0:1784584687.647384:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568965120 00000100:00100000:1.0:1784584687.647436:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1784584687.647446:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568965120:12345-0@lo:101: 00010000:00010000:1.0:1784584687.647460:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584687.647475:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0ecf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584687.647501:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0ecf expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584687.647511:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0ecf expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584687.647520:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c166e000, rc 0) 00000100:00100000:1.0:1784584687.647583:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568965120:12345-0@lo:101: Request processed in 138us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584687.647590:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784584687.648918:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965120:0@lo:101: 00010000:00010000:2.0:1784584687.648939:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584687.648950:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584687.649034:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965248:0@lo:501: 00000100:00100000:2.0:1784584687.649082:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584687.649489:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dae40 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.649899:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568965248 00000100:00100000:3.0:1784584687.649906:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568965248 00000100:00100000:3.0:1784584687.649948:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784584687.649957:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568965248:12345-0@lo:501: 00000100:00100000:3.0:1784584687.650535:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568965248:12345-0@lo:501: Request processed in 578us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.650544:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784584687.650592:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965248:0@lo:501: 00000100:00100000:3.0:1784584687.650631:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965376:0@lo:503: 00000100:00100000:3.0:1784584687.650671:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584687.650718:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.650732:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568965376 00000100:00100000:3.0:1784584687.650735:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568965376 00000100:00100000:3.0:1784584687.650757:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784584687.650763:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568965376:12345-0@lo:503: 00000100:00100000:3.0:1784584687.652750:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568965376:12345-0@lo:503: Request processed in 1979us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.652762:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784584687.653353:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965376:0@lo:503: 00000100:00100000:2.0:1784584687.654173:0:7978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7978:1871272568965504:0@lo:502: 00000100:00100000:2.0:1784584687.654359:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584687.654398:0:7978:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.654758:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568965504 00000100:00100000:3.0:1784584687.654764:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568965504 00000100:00100000:3.0:1784584687.654869:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784584687.654878:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+14:7978:x1871272568965504:12345-0@lo:502: 00000100:00100000:3.0:1784584687.655979:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+14:7978:x1871272568965504:12345-0@lo:502: Request processed in 1099us (1617us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.655989:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1784584687.656235:0:7978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7978:1871272568965504:0@lo:502: 00000100:00100000:2.0:1784584687.656358:0:7978:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7978:1871272568965632:0@lo:502: 00000100:00100000:2.0:1784584687.656397:0:7978:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584687.656420:0:7978:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.656470:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568965632 00000100:00100000:3.0:1784584687.656476:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568965632 00000100:00100000:3.0:1784584687.656540:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784584687.656548:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+14:7978:x1871272568965632:12345-0@lo:502: 00000100:00100000:3.0:1784584687.656729:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+14:7978:x1871272568965632:12345-0@lo:502: Request processed in 181us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.656736:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1784584687.656811:0:7978:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7978:1871272568965632:0@lo:502: 00000040:00080000:2.0:1784584687.656830:0:7978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1784584687.657780:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1784584687.657799:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784584687.657810:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.657821:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584687.657830:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1784584687.657834:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1784584687.657836:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784584687.657866:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.657887:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.657897:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584687.657913:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965760:0@lo:101: 00000100:00100000:0.0:1784584687.657959:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.661375:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171000 going to sleep for 11 seconds 00000100:00100000:1.0:1784584687.661411:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568965760 00000100:00100000:1.0:1784584687.661420:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568965760 00000100:00100000:1.0:1784584687.661464:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1784584687.661473:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568965760:12345-0@lo:101: 00010000:00010000:1.0:1784584687.661489:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584687.661507:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0edd expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584687.661535:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0edd expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584687.661563:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0edd expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584687.661573:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c166f400, rc 0) 00000100:00100000:1.0:1784584687.661639:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568965760:12345-0@lo:101: Request processed in 168us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584687.661646:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784584687.663230:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965760:0@lo:101: 00010000:00010000:0.0:1784584687.663264:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.663276:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584687.663340:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965888:0@lo:501: 00000100:00100000:0.0:1784584687.663392:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.663426:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171000 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.663444:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568965888 00000100:00100000:0.0:1784584687.663449:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568965888 00000100:00100000:0.0:1784584687.663478:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784584687.663486:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568965888:12345-0@lo:501: 00000100:00100000:0.0:1784584687.663750:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568965888:12345-0@lo:501: Request processed in 264us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584687.663757:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784584687.663810:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568965888:0@lo:501: 00000100:00100000:0.0:1784584687.663836:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568966016:0@lo:503: 00000100:00100000:0.0:1784584687.663872:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.663890:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171000 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.663900:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568966016 00000100:00100000:0.0:1784584687.663903:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568966016 00000100:00100000:0.0:1784584687.663919:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784584687.663924:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568966016:12345-0@lo:503: 00000100:00100000:0.0:1784584687.664212:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568966016:12345-0@lo:503: Request processed in 287us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584687.664219:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784584687.664257:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568966016:0@lo:503: 00000100:00100000:0.0:1784584687.664406:0:7980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7980:1871272568966144:0@lo:502: 00000100:00100000:0.0:1784584687.664441:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.664460:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568966144 00000100:00100000:0.0:1784584687.664464:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568966144 00000100:00100000:0.0:1784584687.664481:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784584687.664487:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:7980:x1871272568966144:12345-0@lo:502: 00000100:00100000:0.0:1784584687.664627:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:7980:x1871272568966144:12345-0@lo:502: Request processed in 139us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584687.664634:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1784584687.664663:0:7980:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171780 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.664675:0:7980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7980:1871272568966144:0@lo:502: 00000020:01000000:0.0:1784584687.664716:0:7980:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584687.664725:0:7980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584687.664727:0:7980:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784584687.664737:0:7980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784584687.664740:0:7980:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784584687.664755:0:7980:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7980:1871272568966272:0@lo:502: 00000100:00100000:0.0:1784584687.664785:0:7980:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.664803:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568966272 00000100:00100000:0.0:1784584687.664806:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568966272 00000100:00100000:0.0:1784584687.664822:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784584687.664827:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:7980:x1871272568966272:12345-0@lo:502: 00000100:00100000:0.0:1784584687.664931:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:7980:x1871272568966272:12345-0@lo:502: Request processed in 102us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584687.664939:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1784584687.664971:0:7980:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171780 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.664982:0:7980:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7980:1871272568966272:0@lo:502: 00000020:01000000:0.0:1784584687.664999:0:7980:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584687.665003:0:7980:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584687.665004:0:7980:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784584687.665008:0:7980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1784584687.665051:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1784584687.665066:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784584687.665075:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.665085:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584687.665095:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784584687.665098:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7d687f000 from 30 10000000:01000000:0.0:1784584687.665101:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784584687.665123:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.665138:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.665148:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584687.665159:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568966400:0@lo:101: 00000100:00100000:0.0:1784584687.665185:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.665208:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171780 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.665220:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568966400 00000100:00100000:0.0:1784584687.665223:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568966400 00000100:00100000:0.0:1784584687.665239:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784584687.665244:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568966400:12345-0@lo:101: 00010000:00010000:0.0:1784584687.665253:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584687.665264:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0eeb expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.665283:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0eeb expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.665293:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0eeb expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.665300:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c0030600, rc 0) 00000100:00100000:0.0:1784584687.665325:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568966400:12345-0@lo:101: Request processed in 80us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584687.665330:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784584687.665355:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568966400:0@lo:101: 00010000:00010000:0.0:1784584687.665371:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.665379:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584687.665410:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568966528:0@lo:501: 00000100:00100000:0.0:1784584687.665433:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.665445:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171780 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.665455:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568966528 00000100:00100000:0.0:1784584687.665458:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568966528 00000100:00100000:0.0:1784584687.665474:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784584687.665479:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568966528:12345-0@lo:501: 00000100:00100000:0.0:1784584687.665657:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568966528:12345-0@lo:501: Request processed in 177us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584687.665665:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1784584687.665723:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568966528:0@lo:501: 00000100:00100000:0.0:1784584687.665749:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568966656:0@lo:503: 00000100:00100000:0.0:1784584687.665783:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.665802:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171780 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.665813:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568966656 00000100:00100000:0.0:1784584687.665816:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568966656 00000100:00100000:0.0:1784584687.665835:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784584687.665842:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568966656:12345-0@lo:503: 00000100:00100000:0.0:1784584687.665978:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568966656:12345-0@lo:503: Request processed in 136us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584687.665984:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784584687.666030:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568966656:0@lo:503: 00000100:00100000:3.0:1784584687.666732:0:7981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7981:1871272568966784:0@lo:502: 00000100:00100000:3.0:1784584687.666774:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584687.666811:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568966784 00000100:00100000:3.0:1784584687.666815:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568966784 00000100:00100000:3.0:1784584687.666841:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784584687.666848:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:7981:x1871272568966784:12345-0@lo:502: 00000100:00100000:3.0:1784584687.667018:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:7981:x1871272568966784:12345-0@lo:502: Request processed in 169us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.667024:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1784584687.667056:0:7981:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.667072:0:7981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7981:1871272568966784:0@lo:502: 00000100:00100000:3.0:1784584687.667337:0:7981:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7981:1871272568966912:0@lo:502: 00000100:00100000:3.0:1784584687.667370:0:7981:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584687.667390:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568966912 00000100:00100000:3.0:1784584687.667393:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568966912 00000100:00100000:3.0:1784584687.667416:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784584687.667422:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:7981:x1871272568966912:12345-0@lo:502: 00000100:00100000:3.0:1784584687.667550:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:7981:x1871272568966912:12345-0@lo:502: Request processed in 127us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.667556:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784584687.667587:0:7981:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.667600:0:7981:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7981:1871272568966912:0@lo:502: 00000040:00080000:3.0:1784584687.667622:0:7981:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784584687.667676:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1784584687.667710:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784584687.667720:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.667730:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584687.667739:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784584687.667748:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97c7d687f000 from 5 10000000:01000000:3.0:1784584687.667751:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784584687.667776:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.667847:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.667857:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584687.667870:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967040:0@lo:101: 00000100:00100000:3.0:1784584687.667896:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584687.667909:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.667922:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568967040 00000100:00100000:3.0:1784584687.667925:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568967040 00000100:00100000:3.0:1784584687.667945:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784584687.667950:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568967040:12345-0@lo:101: 00010000:00010000:3.0:1784584687.667958:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584687.667970:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0f00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0ef9 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.667987:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0ef9 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.667996:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0f00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0ef9 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.668004:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c1512400, rc 0) 00000100:00100000:3.0:1784584687.668028:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568967040:12345-0@lo:101: Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.668040:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784584687.668072:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967040:0@lo:101: 00010000:00010000:3.0:1784584687.668154:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.668163:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584687.668332:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967168:0@lo:256: 00000100:00100000:3.0:1784584687.668366:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584687.668380:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.668391:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568967168 00000100:00100000:3.0:1784584687.668394:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568967168 00000100:00100000:3.0:1784584687.668414:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784584687.668420:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568967168:12345-0@lo:256: 20000000:01000000:3.0:1784584687.668431:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784584687.668447:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784584687.668450:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1784584687.668518:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568967168:12345-0@lo:256: Request processed in 98us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.668525:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784584687.668554:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967168:0@lo:256: 10000000:01000000:3.0:1784584687.668594:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784584687.668600:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.668609:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584687.668623:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1784584687.668625:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1784584687.668627:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784584687.668644:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.668651:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.668658:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584687.668670:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967296:0@lo:101: 00000100:00100000:3.0:1784584687.668719:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584687.668733:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.668746:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568967296 00000100:00100000:3.0:1784584687.668749:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568967296 00000100:00100000:3.0:1784584687.668772:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784584687.668778:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568967296:12345-0@lo:101: 00010000:00010000:3.0:1784584687.668934:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584687.668946:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0f07 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.668964:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0f07 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.668973:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0f07 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584687.668991:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c1513200, rc 0) 00000100:00100000:3.0:1784584687.669066:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568967296:12345-0@lo:101: Request processed in 288us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.669072:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1784584687.671163:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967296:0@lo:101: 00010000:00010000:0.0:1784584687.671190:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.671218:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584687.671538:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967424:0@lo:501: 00000100:00100000:0.0:1784584687.671596:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.671637:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.671683:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568967424 00000100:00100000:3.0:1784584687.671712:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568967424 00000100:00100000:3.0:1784584687.671756:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1784584687.671765:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568967424:12345-0@lo:501: 00000100:00100000:3.0:1784584687.672007:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568967424:12345-0@lo:501: Request processed in 243us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.672014:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784584687.672229:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967424:0@lo:501: 00000100:00100000:0.0:1784584687.672383:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967552:0@lo:503: 00000100:00100000:0.0:1784584687.672423:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.672452:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.672494:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568967552 00000100:00100000:3.0:1784584687.672498:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568967552 00000100:00100000:3.0:1784584687.672530:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1784584687.672536:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568967552:12345-0@lo:503: 00000100:00100000:3.0:1784584687.673004:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568967552:12345-0@lo:503: Request processed in 467us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.673011:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1784584687.673082:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568967552:0@lo:503: 00000100:00100000:0.0:1784584687.673638:0:7982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7982:1871272568967680:0@lo:502: 00000100:00100000:0.0:1784584687.673685:0:7982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.673925:0:7982:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.673957:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568967680 00000100:00100000:3.0:1784584687.673962:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568967680 00000100:00100000:3.0:1784584687.674025:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1784584687.674033:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:7982:x1871272568967680:12345-0@lo:502: 00000100:00100000:3.0:1784584687.674379:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:7982:x1871272568967680:12345-0@lo:502: Request processed in 346us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.674386:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1784584687.674529:0:7982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7982:1871272568967680:0@lo:502: 00000020:01000000:2.0:1784584687.674557:0:7982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784584687.674565:0:7982:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1784584687.674573:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584687.674575:0:7982:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1784584687.674581:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1784584687.674585:0:7982:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:2.0:1784584687.674607:0:7982:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1784584687.674611:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784584687.674633:0:7982:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97c7c5c63380) 00000020:00000080:2.0:1784584687.674655:0:7982:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1784584687.674666:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1784584687.674749:0:7982:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1784584687.674755:0:7982:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1784584687.674762:0:7982:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff0f1c 00010000:00080000:2.0:1784584687.674798:0:7982:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7faadd000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1784584687.674995:0:7982:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1784584687.675479:0:7982:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1784584687.675491:0:7982:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784584687.676349:0:7982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584687.676595:0:7982:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584687.676638:0:7982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1784584687.676714:0:7982:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1784584687.677504:0:7983:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784584687.677510:0:7983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784584687.681547:0:7982:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584687.681564:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784584687.681602:0:7982:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784584687.681624:0:7982:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff0f23 00000100:00080000:0.0:1784584687.681634:0:7982:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584687.681640:0:7982:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c7faadd000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1784584687.681673:0:7982:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c6c2274e00 x1871272568967808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584687.681730:0:7982:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784584687.681778:0:7982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584687.681782:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000100:00100000:2.0:1784584687.681881:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272568967808:0@lo:8: 00000100:00100000:2.0:1784584687.681960:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584687.682015:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568967808 00000100:00100000:2.0:1784584687.682022:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568967808 00000100:00100000:2.0:1784584687.682051:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584687.682057:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3319:x1871272568967808:12345-0@lo:8: 00010000:00080000:2.0:1784584687.682093:0:6608:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1784584687.682117:0:6608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff0f2a 00002000:00100000:2.0:1784584687.682129:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97c7faadb000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784584687.682133:0:6608:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1784584687.682137:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784584687.682382:0:6608:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784584687.682523:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784584687.682549:0:6608:0:(import.c:65:import_set_state_nolock()) ffff97c7faadc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584687.682604:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1871272568967808:12345-0@lo:8: Request processed in 545us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584687.682619:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1784584687.682663:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2274e00 x1871272568967808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584697 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584687.682673:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584687.682680:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1784584687.682687:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784584687.682710:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784584687.682713:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7faadd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784584687.682721:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784584687.682726:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272568967808:0@lo:8: 00000004:00080000:2.0:1784584687.682750:0:7983:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784584687.682934:0:7983:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 182790241010ns, next at 0ns, rc = 0 00000020:00000080:0.0:1784584687.683044:0:7982:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784584687.683053:0:7982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584687.683059:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584687.683061:0:7982:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784584687.683064:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784584687.683066:0:7982:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784584687.683165:0:7982:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7982:1871272568967936:0@lo:502: 00000100:00100000:0.0:1784584687.683282:0:7982:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.683318:0:7982:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171240 going to sleep for 11 seconds 00000100:00100000:2.0:1784584687.683366:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568967936 00000100:00100000:2.0:1784584687.683371:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568967936 00000100:00100000:2.0:1784584687.683408:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784584687.683415:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:7982:x1871272568967936:12345-0@lo:502: 00000100:00100000:2.0:1784584687.683610:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:7982:x1871272568967936:12345-0@lo:502: Request processed in 194us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584687.683617:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784584687.683727:0:7982:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:7982:1871272568967936:0@lo:502: 00000020:01000000:0.0:1784584687.683751:0:7982:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584687.683756:0:7982:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584687.683757:0:7982:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784584687.683761:0:7982:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1784584687.683981:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1784584687.683999:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1784584687.684008:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584687.684019:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584687.684040:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1784584687.684042:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97c7c5d4b380 from 1 10000000:01000000:2.0:1784584687.684045:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784584687.684069:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584687.684077:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584687.684158:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584687.684175:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568968064:0@lo:101: 00000100:00100000:2.0:1784584687.684281:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584687.684346:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010da180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.684396:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568968064 00000100:00100000:0.0:1784584687.684401:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568968064 00000100:00100000:0.0:1784584687.684468:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784584687.684476:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568968064:12345-0@lo:101: 00010000:00010000:0.0:1784584687.684486:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584687.684500:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0f31 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.684522:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0f31 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.684533:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0f31 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.684549:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c0030000, rc 0) 00000100:00100000:0.0:1784584687.684593:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568968064:12345-0@lo:101: Request processed in 118us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584687.684601:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784584687.684605:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568968192:0@lo:400: 00000100:00100000:1.0:1784584687.684641:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584687.684666:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584687.684673:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568968320:0@lo:400: 00000100:00100000:1.0:1784584687.684858:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584687.684893:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568968192 00000100:00100000:1.0:1784584687.684897:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568968192 00000100:00100000:1.0:1784584687.684929:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568968320 00000100:00100000:1.0:1784584687.684933:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568968320 00000100:00100000:1.0:1784584687.684964:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784584687.684972:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568968192:12345-0@lo:400: 00000100:00100000:1.0:1784584687.685013:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568968192:12345-0@lo:400: Request processed in 43us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584687.685020:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784584687.685033:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784584687.685040:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568968320:12345-0@lo:400: 00000100:00100000:1.0:1784584687.685067:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568968320:12345-0@lo:400: Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584687.685073:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584687.685098:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568968448:0@lo:400: 00000100:00080000:1.0:1784584687.685106:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784584687.685131:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b1f100 x1871272568968320/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584687.685141:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584687.685150:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568968320:0@lo:400: 00010000:00080000:1.0:1784584687.685164:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b1ca80 x1871272568968192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584687.685172:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584687.685173:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568968192:0@lo:400: 00000100:00100000:3.0:1784584687.685182:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272568968576:0@lo:400: 00000100:00100000:3.0:1784584687.685392:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584687.685428:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568968576 00000100:00100000:3.0:1784584687.685432:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568968576 00000100:00100000:3.0:1784584687.685462:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584687.685469:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272568968576:12345-0@lo:400: 00000100:00100000:3.0:1784584687.685503:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272568968576:12345-0@lo:400: Request processed in 34us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.685509:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584687.685853:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568968448 00000100:00100000:3.0:1784584687.685858:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568968448 00000100:00100000:3.0:1784584687.685886:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584687.685893:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568968448:12345-0@lo:400: 00000100:00100000:3.0:1784584687.685925:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568968448:12345-0@lo:400: Request processed in 33us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.685930:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1784584687.685946:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584687.685949:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784584687.685967:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b1ce00 x1871272568968576/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584687.685977:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272568968576:0@lo:400: 00010000:00080000:3.0:1784584687.685986:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b1c380 x1871272568968448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584687.685994:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568968448:0@lo:400: 00000100:00100000:1.0:1784584687.689063:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568968064:0@lo:101: 00010000:00010000:1.0:1784584687.689097:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584687.689109:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584687.689179:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568968704:0@lo:501: 00000100:00100000:1.0:1784584687.689248:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584687.689300:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d87986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.691853:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568968704 00000100:00100000:0.0:1784584687.691865:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568968704 00000100:00100000:0.0:1784584687.691916:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784584687.691925:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568968704:12345-0@lo:501: 00000100:00100000:0.0:1784584687.692929:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568968704:12345-0@lo:501: Request processed in 1002us (3678us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784584687.692939:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784584687.692983:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568968704:0@lo:501: 10000000:01000000:0.0:1784584687.693016:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784584687.693025:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584687.693105:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784584687.724479:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1784584687.724540:0:7984:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1784584687.724548:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568968832:0@lo:13: 00000100:00100000:0.0:1784584687.724560:0:7984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7984:1871272568968960:0@lo:7: 00000100:00100000:1.0:1784584687.725392:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584687.726457:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568968832 00000100:00100000:3.0:1784584687.726468:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568968832 00000100:00100000:3.0:1784584687.726537:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784584687.726548:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272568968832:12345-0@lo:13: 00002000:00000024:3.0:1784584687.726586:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1784584687.726650:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272568968832:12345-0@lo:13: Request processed in 106us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584687.726656:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1784584687.726771:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784584687.726989:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2274380 x1871272568968832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584703 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584687.727008:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568968832:0@lo:13: 00000100:00100000:1.0:1784584687.727051:0:7984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584687.727081:0:7984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f41710c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584687.727181:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568968960 00000100:00100000:2.0:1784584687.727186:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568968960 00000100:00100000:2.0:1784584687.727289:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584687.727296:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7984:x1871272568968960:12345-0@lo:7: 00002000:00080000:2.0:1784584687.737942:0:6607:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1784584687.737950:0:6607:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1784584687.738096:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7984:x1871272568968960:12345-0@lo:7: Request processed in 10789us (11033us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584687.738107:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1784584687.738347:0:7984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2277100 x1871272568968960/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1784584703 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584687.738361:0:7984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7984:1871272568968960:0@lo:7: 00000004:00080000:0.0:1784584687.738383:0:7984:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784584687.738418:0:7984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7984:1871272568969088:0@lo:5: 00000100:00100000:0.0:1784584687.738450:0:7984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.738518:0:7984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f41710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.738554:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568969088 00000100:00100000:3.0:1784584687.738561:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568969088 00000100:00100000:3.0:1784584687.738630:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584687.738640:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7984:x1871272568969088:12345-0@lo:5: 00002000:00080000:3.0:1784584687.738664:0:6608:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1784584687.738668:0:6608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1784584687.739440:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7984:x1871272568969088:12345-0@lo:5: Request processed in 798us (986us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1784584687.739448:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1784584687.739497:0:7984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2277100 x1871272568969088/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584703 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584687.739510:0:7984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7984:1871272568969088:0@lo:5: 00000004:00080000:0.0:1784584687.739520:0:7984:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784584687.739545:0:7984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2275f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7984:1871272568969216:0@lo:700: 00000100:00100000:0.0:1784584687.739569:0:7984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584687.739615:0:7984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f41710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584687.739642:0:6614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568969216 00000100:00100000:3.0:1784584687.739648:0:6614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568969216 00000100:00100000:3.0:1784584687.739904:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584687.739913:0:6614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7984:x1871272568969216:12345-0@lo:700: 00000100:00100000:3.0:1784584687.739942:0:6614:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6614:1871272568969344:0@lo:700: 00000100:00100000:3.0:1784584687.739967:0:6614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584687.739988:0:6614:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584687.740022:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568969344 00000100:00100000:0.0:1784584687.740026:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568969344 00000100:00100000:0.0:1784584687.740092:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584687.740099:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6614:x1871272568969344:12345-0@lo:700: 40000000:02000000:0.0:1784584687.770988:0:5813:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1784584687.779615:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6614:x1871272568969344:12345-0@lo:700: Request processed in 39508us (39638us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584687.779633:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784584687.779899:0:6614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8010bc380 x1871272568969344/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1784584703 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584687.779914:0:6614:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6614:1871272568969344:0@lo:700: 40000000:02000000:3.0:1784584687.779933:0:6614:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:0.0:1784584687.843419:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784584687.843435:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1784584687.843448:0:6614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7984:x1871272568969216:12345-0@lo:700: Request processed in 103531us (103873us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584687.843467:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1784584687.846551:0:7984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2275f80 x1871272568969216/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1784584703 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584687.846569:0:7984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2275f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7984:1871272568969216:0@lo:700: 00000004:02000040:0.0:1784584687.879988:0:7984:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1784584687.891494:0:7984:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7984:1871272568969472:0@lo:5: 00000100:00100000:2.0:1784584687.891560:0:7984:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584687.891592:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568969472 00000100:00100000:2.0:1784584687.891599:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568969472 00000100:00100000:2.0:1784584687.891709:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584687.891719:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7984:x1871272568969472:12345-0@lo:5: 00000100:00100000:0.0:1784584687.893926:0:7984:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7e92f00 going to sleep for 11 seconds 00002000:00080000:2.0:1784584687.898410:0:6607:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1784584687.898429:0:6607:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1784584687.902293:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7984:x1871272568969472:12345-0@lo:5: Request processed in 10569us (10726us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784584687.902306:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1784584687.902568:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1784584687.902658:0:7984:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7c40f4700 x1871272568969472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584703 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584687.902676:0:7984:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1784584687.902709:0:7984:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97c7c40f4700 x1871272568969472/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1784584703 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584687.902793:0:7984:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7984:1871272568969472:0@lo:5: 00000004:00080000:0.0:1784584687.902807:0:7984:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:00080000:0.0:1784584688.863862:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1784584688.927249:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584689.357607:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584689.357989:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549023872 00000100:00100000:2.0:1784584689.357998:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549023872 00000100:00100000:2.0:1784584689.358037:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:2.0:1784584689.358045:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1871272549023872:12345-192.168.203.52@tcp:250: 00010000:00080000:2.0:1784584689.358071:0:5800:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 124465d0-a979-47fc-b1e9-56d9fa9a31c6@192.168.203.52@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1784584689.358094:0:5800:0:(genops.c:1406:class_connect()) connect: client 124465d0-a979-47fc-b1e9-56d9fa9a31c6, cookie 0x787d778cc3ff0f3f 00000100:00080000:2.0:1784584689.358221:0:5800:0:(import.c:65:import_set_state_nolock()) ffff97c7faada000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584689.358283:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+5:2353:x1871272549023872:12345-192.168.203.52@tcp:250: Request processed in 237us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584689.358291:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:3.0:1784584689.366377:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584689.366516:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549024000 00000100:00100000:2.0:1784584689.366525:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549024000 00000100:00100000:2.0:1784584689.366573:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:2.0:1784584689.366584:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+5:5556:x1871272549024000:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1784584689.366609:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584689.366627:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2cf0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584689.366654:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf0 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584689.366665:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf0 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584689.366675:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fce00, rc 0) 00000100:00100000:2.0:1784584689.366759:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+6:5556:x1871272549024000:12345-192.168.203.52@tcp:101: Request processed in 176us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584689.366766:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:3.0:1784584689.371848:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584689.378565:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549024128 00000100:00100000:1.0:1784584689.378579:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549024128 00000100:00100000:1.0:1784584689.378646:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:1.0:1784584689.378657:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+6:5556:x1871272549024128:12345-192.168.203.52@tcp:501: 00000100:00100000:1.0:1784584689.379397:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+6:5556:x1871272549024128:12345-192.168.203.52@tcp:501: Request processed in 738us (7555us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784584689.379406:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:1.0:1784584689.381816:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584689.381928:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549024256 00000100:00100000:0.0:1784584689.381936:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549024256 00000100:00100000:0.0:1784584689.381988:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:0.0:1784584689.381998:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+6:5556:x1871272549024256:12345-192.168.203.52@tcp:101: 00010000:00010000:0.0:1784584689.382013:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584689.382030:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2cf7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584689.382057:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf7 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584689.382068:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf7 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584689.382076:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf200, rc 0) 00000100:00100000:0.0:1784584689.382124:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+7:5556:x1871272549024256:12345-192.168.203.52@tcp:101: Request processed in 128us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584689.382131:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:3.0:1784584689.384350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584689.384444:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549024384 00000100:00100000:0.0:1784584689.384466:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549024384 00000100:00100000:0.0:1784584689.384514:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:0.0:1784584689.384524:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+7:5556:x1871272549024384:12345-192.168.203.52@tcp:501: 00000100:00100000:0.0:1784584689.384798:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:5556:x1871272549024384:12345-192.168.203.52@tcp:501: Request processed in 275us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584689.384806:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:0.0:1784584689.386471:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584689.386545:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549024512 00000100:00100000:1.0:1784584689.386553:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549024512 00000100:00100000:1.0:1784584689.386598:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:1.0:1784584689.386607:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:5556:x1871272549024512:12345-192.168.203.52@tcp:503: 00000100:00100000:1.0:1784584689.387053:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:5556:x1871272549024512:12345-192.168.203.52@tcp:503: Request processed in 446us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584689.387062:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:3.0:1784584689.393681:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584689.394079:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549024640 00000100:00100000:1.0:1784584689.394089:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549024640 00000100:00100000:1.0:1784584689.394525:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:1.0:1784584689.394534:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:5574:x1871272549024640:12345-192.168.203.52@tcp:502: 00000100:00100000:1.0:1784584689.395004:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:5574:x1871272549024640:12345-192.168.203.52@tcp:502: Request processed in 470us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584689.395014:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1784584689.438297:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584689.438332:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549024768 00000100:00100000:3.0:1784584689.438340:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549024768 00000100:00100000:3.0:1784584689.438387:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1784584689.438397:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:5574:x1871272549024768:12345-192.168.203.52@tcp:502: 00000100:00100000:3.0:1784584689.440366:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:5574:x1871272549024768:12345-192.168.203.52@tcp:502: Request processed in 1962us (2071us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584689.440379:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:2.0:1784584689.444330:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584689.444773:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549024896 00000100:00100000:0.0:1784584689.444783:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549024896 00000100:00100000:0.0:1784584689.444828:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:0.0:1784584689.444837:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:5556:x1871272549024896:12345-192.168.203.52@tcp:101: 00010000:00010000:0.0:1784584689.444852:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584689.444870:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bfc00/0x787d778cc3ff0f54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2d21 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584689.444897:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bfc00/0x787d778cc3ff0f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d21 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584689.444908:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bfc00/0x787d778cc3ff0f54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d21 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584689.444917:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfc00, rc 0) 00000100:00100000:0.0:1784584689.444965:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5556:x1871272549024896:12345-192.168.203.52@tcp:101: Request processed in 129us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584689.444971:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:3.0:1784584689.450303:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584689.450547:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549025024 00000100:00100000:1.0:1784584689.450557:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549025024 00000100:00100000:1.0:1784584689.450616:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:1.0:1784584689.450626:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5556:x1871272549025024:12345-192.168.203.52@tcp:256: 20000000:01000000:1.0:1784584689.450671:0:5800:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784584689.450686:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784584689.450711:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784584689.450724:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784584689.450726:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1784584689.456066:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5556:x1871272549025024:12345-192.168.203.52@tcp:256: Request processed in 5430us (5760us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584689.456081:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:3.0:1784584689.461788:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584689.461939:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549025152 00000100:00100000:0.0:1784584689.461948:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549025152 00000100:00100000:0.0:1784584689.461992:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1784584689.462010:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5556:x1871272549025152:12345-192.168.203.52@tcp:101: 00010000:00010000:0.0:1784584689.462025:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584689.462039:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2d28 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584689.462064:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d28 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584689.462076:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d28 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584689.462084:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf600, rc 0) 00000100:00100000:0.0:1784584689.462126:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5556:x1871272549025152:12345-192.168.203.52@tcp:101: Request processed in 119us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584689.462133:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1784584689.469084:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584689.469193:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549025280 00000100:00100000:2.0:1784584689.469204:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549025280 00000100:00100000:2.0:1784584689.469260:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1784584689.469271:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5556:x1871272549025280:12345-192.168.203.52@tcp:501: 00000100:00100000:2.0:1784584689.469520:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5556:x1871272549025280:12345-192.168.203.52@tcp:501: Request processed in 251us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584689.469527:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:3.0:1784584689.472981:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584689.473072:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549025408 00000100:00100000:0.0:1784584689.473081:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549025408 00000100:00100000:0.0:1784584689.473135:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:0.0:1784584689.473146:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5556:x1871272549025408:12345-192.168.203.52@tcp:503: 00000100:00100000:0.0:1784584689.473539:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5556:x1871272549025408:12345-192.168.203.52@tcp:503: Request processed in 393us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584689.473548:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1784584689.481060:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584689.481145:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549025536 00000100:00100000:3.0:1784584689.481154:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549025536 00000100:00100000:3.0:1784584689.481216:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:3.0:1784584689.481226:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5577:x1871272549025536:12345-192.168.203.52@tcp:502: 00000100:00100000:3.0:1784584689.481480:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5577:x1871272549025536:12345-192.168.203.52@tcp:502: Request processed in 254us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584689.481488:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:3.0:1784584689.491009:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584689.491189:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549025664 00000100:00100000:1.0:1784584689.491200:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549025664 00000100:00100000:1.0:1784584689.491260:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:1.0:1784584689.491270:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5577:x1871272549025664:12345-192.168.203.52@tcp:502: 00000100:00100000:1.0:1784584689.491504:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5577:x1871272549025664:12345-192.168.203.52@tcp:502: Request processed in 235us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584689.491512:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:3.0:1784584689.497589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584689.498039:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549025792 00000100:00100000:1.0:1784584689.498049:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549025792 00000100:00100000:1.0:1784584689.498098:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1784584689.498105:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1871272549025792:12345-192.168.203.52@tcp:38: 00010000:00080000:1.0:1784584689.498146:0:5807:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:1.0:1784584689.498209:0:5807:0:(genops.c:1406:class_connect()) connect: client 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2, cookie 0x787d778cc3ff0f62 00000004:00100000:1.0:1784584689.498239:0:5807:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1784584689.498257:0:5807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1784584689.522113:0:5807:0:(import.c:65:import_set_state_nolock()) ffff97c7c5ee5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584689.522206:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2353:x1871272549025792:12345-192.168.203.52@tcp:38: Request processed in 24098us (24624us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584689.522230:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1784584689.694497:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784584689.694531:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568969600:0@lo:13: 00000100:00100000:3.0:1784584689.694592:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584689.694801:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568969600 00000100:00100000:2.0:1784584689.694808:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568969600 00000100:00100000:2.0:1784584689.694870:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584689.694879:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568969600:12345-0@lo:13: 00002000:00000024:2.0:1784584689.694910:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584689.694962:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568969600:12345-0@lo:13: Request processed in 85us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584689.694969:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1784584689.695801:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784584689.695841:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7c40f5c00 x1871272568969600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584705 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584689.695860:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568969600:0@lo:13: 00010000:00010000:3.0:1784584689.947907:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584690.532009:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584690.532066:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584690.532225:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549025920 00000100:00100000:3.0:1784584690.532235:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549025920 00000100:00100000:3.0:1784584690.532304:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549026048 00000100:00100000:3.0:1784584690.532307:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549026048 00000100:00100000:3.0:1784584690.532332:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1784584690.532343:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:0:x1871272549025920:12345-192.168.203.52@tcp:41: 00000004:00000024:3.0:1784584690.532390:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784584690.532411:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1784584690.532429:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:5556:x1871272549026048:12345-192.168.203.52@tcp:41: 00000100:00100000:3.0:1784584690.532459:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2277100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:0:x1871272549025920:12345-192.168.203.52@tcp:41: Request processed in 116us (459us total) trans 0 rc 0/0 00000004:00000024:0.0:1784584690.532467:0:6997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784584690.532468:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1784584690.532506:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5556:x1871272549026048:12345-192.168.203.52@tcp:41: Request processed in 84us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584690.532513:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00080000:2.0:1784584690.532840:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584690.534449:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584690.534531:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549026176 00000100:00100000:3.0:1784584690.534539:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549026176 00000100:00100000:3.0:1784584690.534592:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1784584690.534601:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5556:x1871272549026176:12345-192.168.203.52@tcp:40: 00000100:00100000:3.0:1784584690.534679:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5556:x1871272549026176:12345-192.168.203.52@tcp:40: Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584690.534686:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1784584690.545450:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584690.545961:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584690.546047:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584690.546367:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549026560 00000100:00100000:0.0:1784584690.546375:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549026560 00000100:00100000:0.0:1784584690.546426:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:0.0:1784584690.546435:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549026560:12345-192.168.203.52@tcp:400: 00000100:00100000:0.0:1784584690.546504:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549026560:12345-192.168.203.52@tcp:400: Request processed in 70us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584690.546512:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:3.0:1784584690.547266:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584690.547989:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549026304 00000100:00100000:1.0:1784584690.547997:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549026304 00000100:00100000:1.0:1784584690.548029:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549026432 00000100:00100000:1.0:1784584690.548033:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549026432 00000100:00100000:1.0:1784584690.548047:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1784584690.548093:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549026688 00000100:00100000:0.0:1784584690.548098:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549026688 00000100:00100000:0.0:1784584690.548132:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1784584690.548139:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5556:x1871272549026688:12345-192.168.203.52@tcp:33: 00000100:00100000:1.0:1784584690.548254:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1871272549026304:12345-192.168.203.52@tcp:8: 00010000:00080000:1.0:1784584690.548279:0:6605:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1784584690.548323:0:6605:0:(genops.c:1406:class_connect()) connect: client 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2, cookie 0x787d778cc3ff0f69 00002000:00100000:1.0:1784584690.548334:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2/ffff97c7c5ee1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784584690.548345:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784584690.550465:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784584690.550507:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7c5ee0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584690.551403:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2353:x1871272549026304:12345-192.168.203.52@tcp:8: Request processed in 3344us (5956us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584690.551414:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1784584690.551446:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1784584690.551453:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1871272549026432:12345-192.168.203.52@tcp:8: 00010000:00080000:1.0:1784584690.551477:0:6605:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1784584690.551504:0:6605:0:(genops.c:1406:class_connect()) connect: client 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2, cookie 0x787d778cc3ff0f70 00002000:00100000:1.0:1784584690.551939:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2/ffff97c7c5ee5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784584690.551963:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784584690.555376:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784584690.555418:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7c5ee3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584690.555573:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2353:x1871272549026432:12345-192.168.203.52@tcp:8: Request processed in 4117us (9611us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584690.555584:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000004:00080000:2.0:1784584690.562343:0:5809:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 14137us 00000004:00200000:1.0:1784584690.574116:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1784584690.574894:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5556:x1871272549026688:12345-192.168.203.52@tcp:33: Request processed in 26749us (27623us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584690.574908:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1784584690.776799:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584690.776914:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549026816 00000100:00100000:1.0:1784584690.776924:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549026816 00000100:00100000:1.0:1784584690.776997:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1784584690.777007:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5594:x1871272549026816:12345-192.168.203.52@tcp:101: 00010000:00010000:1.0:1784584690.777027:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584690.777086:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c166f600/0x787d778cc3ff0f77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2d52 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584690.777147:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c166fe00/0x787d778cc3ff0f7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584690.777161:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c166fe00/0x787d778cc3ff0f7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584690.777186:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c166fe00/0x787d778cc3ff0f7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584690.777376:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784584690.777381:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584690.777457:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c166fe00/0x787d778cc3ff0f7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584690.777491:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c166f600/0x787d778cc3ff0f77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d52 expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584690.777519:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c166fe00/0x787d778cc3ff0f7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d52 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584690.777528:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584690.777531:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584690.777534:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c166fe00, rc 0) 00000100:00100000:1.0:1784584690.777593:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:5594:x1871272549026816:12345-192.168.203.52@tcp:101: Request processed in 587us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584690.777600:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00010000:00010000:0.0:1784584690.973060:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584691.996053:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584692.764153:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568969728:0@lo:400: 00000100:00100000:3.0:1784584692.764234:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584692.764294:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584692.764300:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568969856:0@lo:400: 00000100:00100000:3.0:1784584692.764326:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584692.764371:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568969728 00000100:00100000:3.0:1784584692.764379:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568969728 00000100:00100000:3.0:1784584692.764417:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784584692.764425:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568969728:12345-0@lo:400: 00000100:00100000:3.0:1784584692.764471:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568969728:12345-0@lo:400: Request processed in 46us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584692.764478:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1784584692.764512:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568969856 00000100:00100000:3.0:1784584692.764515:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568969856 00000100:00100000:3.0:1784584692.764544:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784584692.764551:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568969856:12345-0@lo:400: 00000100:00100000:3.0:1784584692.764582:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568969856:12345-0@lo:400: Request processed in 31us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584692.764588:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784584692.764621:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568969856:0@lo:400: 00000100:00100000:3.0:1784584692.764631:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568969728:0@lo:400: 00000100:00100000:3.0:1784584692.766143:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568970112:0@lo:13: 00000100:00100000:3.0:1784584692.766219:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584692.766247:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584692.766253:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272568969984:0@lo:400: 00000100:00100000:3.0:1784584692.766287:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584692.766388:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568969984 00000100:00100000:3.0:1784584692.766394:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568969984 00000100:00100000:3.0:1784584692.766432:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584692.766440:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871272568969984:12345-0@lo:400: 00000100:00100000:3.0:1784584692.766479:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871272568969984:12345-0@lo:400: Request processed in 40us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584692.766484:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584692.766518:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272568969984:0@lo:400: 00000100:00100000:2.0:1784584692.766960:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568970368:0@lo:400: 00000100:00100000:2.0:1784584692.766995:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584692.767023:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784584692.767029:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568970240:0@lo:400: 00000100:00100000:2.0:1784584692.767048:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584692.767085:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568970112 00000100:00100000:2.0:1784584692.767088:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568970112 00000100:00100000:2.0:1784584692.767119:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784584692.767124:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568970112:12345-0@lo:13: 00002000:00000024:2.0:1784584692.767151:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584692.767192:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568970112:12345-0@lo:13: Request processed in 67us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584692.767197:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1784584692.767213:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584692.767217:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584692.767225:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568970368 00000100:00100000:2.0:1784584692.767228:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568970368 00000100:00100000:2.0:1784584692.767256:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584692.767262:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568970368:12345-0@lo:400: 00000100:00100000:2.0:1784584692.767292:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568970368:12345-0@lo:400: Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584692.767297:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584692.767322:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568970240 00000100:00100000:2.0:1784584692.767325:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568970240 00000100:00100000:2.0:1784584692.767428:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784584692.767434:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568970240:12345-0@lo:400: 00000100:00100000:2.0:1784584692.767465:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568970240:12345-0@lo:400: Request processed in 31us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584692.767470:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1784584692.767486:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584692.767489:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784584692.767508:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b1d500 x1871272568970240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584692.767519:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568970240:0@lo:400: 00000100:00100000:2.0:1784584692.767530:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568970368:0@lo:400: 00010000:00080000:3.0:1784584692.769921:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2277800 x1871272568970112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584708 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584692.769935:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1784584692.769960:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568970112:0@lo:13: 00000100:00100000:0.0:1784584693.005127:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584693.006261:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549026944 00000100:00100000:3.0:1784584693.006273:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549026944 00000100:00100000:3.0:1784584693.006427:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:3.0:1784584693.006439:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:5646:x1871272549026944:12345-192.168.203.52@tcp:41: 00000004:00000024:3.0:1784584693.006480:0:5808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784584693.006565:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:5646:x1871272549026944:12345-192.168.203.52@tcp:41: Request processed in 128us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584693.006572:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:2.0:1784584693.010989:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584693.012035:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584693.012245:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549027072 00000100:00100000:2.0:1784584693.012254:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549027072 00000100:00100000:2.0:1784584693.012331:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1784584693.012343:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5646:x1871272549027072:12345-192.168.203.52@tcp:13: 00002000:00000024:2.0:1784584693.012379:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584693.012446:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5646:x1871272549027072:12345-192.168.203.52@tcp:13: Request processed in 106us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584693.012454:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00080000:0.0:1784584693.013133:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584693.019517:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584693.019673:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549027200 00000100:00100000:3.0:1784584693.019771:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549027200 00000100:00100000:3.0:1784584693.019832:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1784584693.019842:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5646:x1871272549027200:12345-192.168.203.52@tcp:13: 00002000:00000024:3.0:1784584693.019869:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584693.019931:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:5646:x1871272549027200:12345-192.168.203.52@tcp:13: Request processed in 90us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584693.019938:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00080000:0.0:1784584693.020008:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784584693.020667:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584694.044259:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784584694.329300:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000100:00100000:3.0:1784584694.812104:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584694.812131:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568970496:0@lo:13: 00000100:00100000:3.0:1784584694.812213:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584694.812277:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568970496 00000100:00100000:3.0:1784584694.812283:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568970496 00000100:00100000:3.0:1784584694.812462:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784584694.812471:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568970496:12345-0@lo:13: 00002000:00000024:3.0:1784584694.812491:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584694.812539:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568970496:12345-0@lo:13: Request processed in 69us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584694.812546:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1784584694.812563:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784584694.812587:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2277480 x1871272568970496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584710 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584694.813113:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568970496:0@lo:13: 00000001:00100000:2.0:1784584694.908561:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000001:00100000:0.0:1784584694.918265:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00010000:00010000:0.0:1784584695.068318:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784584695.725469:0:8164:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1784584695.748549:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584695.748603:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584695.748640:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584695.748679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584695.748787:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549027584 00000100:00100000:0.0:1784584695.748800:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549027584 00000100:00100000:0.0:1784584695.748881:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549027712 00000100:00100000:0.0:1784584695.748885:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549027712 00000100:00100000:0.0:1784584695.748910:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1784584695.748941:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2356:x1871272549027584:12345-192.168.203.52@tcp:400: 00000100:00100000:0.0:1784584695.749044:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2356:x1871272549027584:12345-192.168.203.52@tcp:400: Request processed in 106us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584695.749052:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1784584695.749074:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1784584695.749082:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2356:x1871272549027712:12345-192.168.203.52@tcp:400: 00000100:00100000:0.0:1784584695.749105:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2356:x1871272549027712:12345-192.168.203.52@tcp:400: Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584695.749112:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00080000:1.0:1784584695.749430:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784584695.749435:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584695.749514:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549027456 00000100:00100000:2.0:1784584695.749520:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549027456 00000100:00100000:2.0:1784584695.749569:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1784584695.749584:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549027456:12345-192.168.203.52@tcp:400: 00000100:00100000:2.0:1784584695.749625:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549027456:12345-192.168.203.52@tcp:400: Request processed in 42us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584695.749632:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:1.0:1784584695.749857:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584695.750044:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549027328 00000100:00100000:3.0:1784584695.750050:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549027328 00000100:00100000:3.0:1784584695.752277:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:3.0:1784584695.752298:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549027328:12345-192.168.203.52@tcp:400: 00000100:00100000:3.0:1784584695.753477:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549027328:12345-192.168.203.52@tcp:400: Request processed in 1181us (4938us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584695.753488:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00010000:00010000:3.0:1784584696.092345:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584697.118363:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584697.885242:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584697.885268:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568970624:0@lo:13: 00000100:00100000:2.0:1784584697.885340:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584697.885414:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568970624 00000100:00100000:2.0:1784584697.885420:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568970624 00000100:00100000:2.0:1784584697.885479:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584697.885489:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568970624:12345-0@lo:13: 00002000:00000024:2.0:1784584697.885523:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584697.885567:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568970624:12345-0@lo:13: Request processed in 80us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584697.885574:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1784584697.885598:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784584697.885629:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7c40f4a80 x1871272568970624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584713 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584697.885647:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568970624:0@lo:13: 00000100:00100000:1.0:1784584697.887728:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2276680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568970752:0@lo:400: 00000100:00100000:2.0:1784584697.887746:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568970880:0@lo:400: 00000100:00100000:2.0:1784584697.887809:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584697.887856:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568971008:0@lo:400: 00000100:00100000:2.0:1784584697.887882:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584697.887904:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568970880 00000100:00100000:2.0:1784584697.887905:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584697.887913:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568970880 00000100:00100000:2.0:1784584697.887914:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568971136:0@lo:400: 00000100:00100000:2.0:1784584697.887944:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584697.887965:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568971008 00000100:00100000:0.0:1784584697.887969:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568971008 00000100:00100000:2.0:1784584697.887995:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584697.888006:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568970880:12345-0@lo:400: 00000100:00100000:2.0:1784584697.888053:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568970880:12345-0@lo:400: Request processed in 49us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584697.888082:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584697.888118:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272568971264:0@lo:400: 00000100:00100000:1.0:1784584697.888162:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584697.888194:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568970752 00000100:00100000:1.0:1784584697.888198:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568970752 00000100:00100000:1.0:1784584697.888226:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784584697.888233:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568970752:12345-0@lo:400: 00000100:00100000:1.0:1784584697.888289:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568970752:12345-0@lo:400: Request processed in 56us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584697.888296:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1784584697.888326:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568971264 00000100:00100000:1.0:1784584697.888330:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568971264 00000100:00100000:0.0:1784584697.888967:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784584697.888979:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568971008:12345-0@lo:400: 00000100:00100000:0.0:1784584697.889159:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568971008:12345-0@lo:400: Request processed in 183us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584697.889166:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784584697.889215:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2276680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568970752:0@lo:400: 00000100:00100000:3.0:1784584697.889516:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568971008:0@lo:400: 00000100:00100000:2.0:1784584697.893804:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584697.893861:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568971136 00000100:00100000:2.0:1784584697.893869:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568971136 00000100:00100000:2.0:1784584697.893930:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584697.893941:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568971136:12345-0@lo:400: 00000100:00100000:2.0:1784584697.894028:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568971136:12345-0@lo:400: Request processed in 90us (6083us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584697.894035:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1784584697.894060:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584697.894065:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584697.894097:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568970880:0@lo:400: 00010000:00080000:2.0:1784584697.894143:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2276300 x1871272568971136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584697.894154:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568971136:0@lo:400: 00000100:00100000:1.0:1784584697.897005:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784584697.897022:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272568971264:12345-0@lo:400: 00000100:00100000:1.0:1784584697.897105:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272568971264:12345-0@lo:400: Request processed in 88us (8941us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584697.897112:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784584697.897164:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272568971264:0@lo:400: 00010000:00010000:3.0:1784584698.139962:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784584698.790428:0:8312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6f9563d0 20000000:00000080:3.0:1784584698.790453:0:8312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c801ac9800 uarg=0000000000000000 20000000:01000000:3.0:1784584698.790501:0:8312:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1784584698.790504:0:8312:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1784584698.790507:0:8312:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1784584698.790514:0:8312:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1784584698.790521:0:8312:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1784584698.790538:0:8312:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784584698.790541:0:8312:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784584698.790909:0:8312:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1784584698.790913:0:8312:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1784584698.792564:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1784584698.793477:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1784584698.793561:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1784584698.793603:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1784584698.793620:0:8312:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1784584698.793623:0:8312:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784584698.795198:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1784584698.797539:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1784584698.797617:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1784584698.802042:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1784584698.802097:0:8312:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784584698.802101:0:8312:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784584698.803600:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1784584698.804521:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1784584698.804595:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1784584698.804935:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1784584698.804955:0:8312:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784584698.804958:0:8312:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1784584698.806087:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1784584698.806600:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1784584698.806996:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1784584698.807060:0:8312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:3.0:1784584698.807080:0:8312:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784584698.807105:0:8312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807155:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e7b expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807163:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0ea5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807170:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0ecf expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807177:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0edd expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807184:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0eeb expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807192:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0f07 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807199:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0f31 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807210:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf0 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807218:0:8312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf7 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807226:0:8312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807288:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf7 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807304:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf7 expref: 9 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.807322:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971392:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584698.807550:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf0 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807559:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf0 expref: 9 pid: 5798 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.807568:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971520:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584698.807605:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0f31 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807613:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0f31 expref: 18 pid: 5798 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.807623:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971648:0@lo:104: 00000100:00100000:3.0:1784584698.807687:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584698.807958:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0f07 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.807968:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0f07 expref: 18 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.807988:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971776:0@lo:104: 00000100:00100000:3.0:1784584698.808014:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784584698.808325:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0eeb expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.808334:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0eeb expref: 18 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.808352:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971904:0@lo:104: 00010000:00010000:3.0:1784584698.808378:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0edd expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.808385:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0edd expref: 18 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.808394:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568972032:0@lo:104: 00010000:00010000:3.0:1784584698.808418:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0ecf expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.808425:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0ecf expref: 18 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.808432:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568972160:0@lo:104: 00010000:00010000:3.0:1784584698.808451:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0ea5 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.808458:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0ea5 expref: 18 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.808477:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568972288:0@lo:104: 00010000:00010000:3.0:1784584698.808499:0:8312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0e7b expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584698.808506:0:8312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0e7b expref: 18 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.808514:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568972416:0@lo:104: 00000100:00100000:3.0:1784584698.808529:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d867fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584698.808602:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1784584698.808621:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584698.808780:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584698.808949:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568971648 00000100:00100000:2.0:1784584698.808957:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568971648 00000100:00100000:2.0:1784584698.809002:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568971776 00000100:00100000:2.0:1784584698.809004:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568971776 00000100:00100000:2.0:1784584698.809012:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568971904 00000100:00100000:2.0:1784584698.809015:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568971904 00000100:00100000:2.0:1784584698.809027:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584698.809035:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+5:8312:x1871272568971648:12345-0@lo:104: 00010000:00010000:2.0:1784584698.809051:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.809165:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784584698.809171:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+5:8312:x1871272568971648:12345-0@lo:104: Request processed in 137us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584698.809179:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584698.809198:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584698.809203:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f45cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+4:8312:x1871272568971776:12345-0@lo:104: 00010000:00010000:2.0:1784584698.809211:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.809244:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784584698.809248:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f45cf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+4:8312:x1871272568971776:12345-0@lo:104: Request processed in 46us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584698.809254:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584698.809291:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584698.809296:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:8312:x1871272568971904:12345-0@lo:104: 00010000:00010000:2.0:1784584698.809303:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.809327:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1784584698.809332:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:8312:x1871272568971904:12345-0@lo:104: Request processed in 36us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584698.809337:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1784584698.809408:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784584698.809423:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809431:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fdc00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584698.809436:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809445:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584698.809453:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584698.809459:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784584698.809498:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809505:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584698.809525:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809533:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fdc00/0x787d778cc3ff0f31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0f38 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809547:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584698.809550:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809556:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c1513800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584698.809559:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809577:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584698.809583:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584698.809589:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784584698.809603:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809609:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584698.809624:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809631:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c1513800/0x787d778cc3ff0f07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0f0e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809653:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584698.809656:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809662:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c0031000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584698.809665:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809672:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584698.809678:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584698.809689:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784584698.809749:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809755:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584698.809761:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809768:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c0031000/0x787d778cc3ff0eeb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ef2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.809778:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584698.809780:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584698.809782:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584698.809925:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2276680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568972544:0@lo:103: 00000100:00100000:0.0:1784584698.809965:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584698.810015:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568972672:0@lo:103: 00000100:00100000:0.0:1784584698.810039:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584698.810058:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584698.810063:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568972800:0@lo:103: 00000100:00100000:0.0:1784584698.810082:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584698.810111:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568972544 00000100:00100000:0.0:1784584698.810117:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568972544 00010000:00010000:0.0:1784584698.810158:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0f31 expref: 19 pid: 5798 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584698.810173:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568972672 00000100:00100000:0.0:1784584698.810176:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568972672 00010000:00010000:0.0:1784584698.810198:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0f07 expref: 20 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584698.810210:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568972800 00000100:00100000:0.0:1784584698.810212:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568972800 00010000:00010000:0.0:1784584698.810222:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0eeb expref: 21 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584698.810233:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584698.810239:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+21:3323:x1871272568972544:12345-0@lo:103: 00010000:00010000:0.0:1784584698.810252:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584698.810258:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0f31 expref: 21 pid: 5798 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.810269:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0f31 expref: 21 pid: 5798 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.810288:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584698.810317:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+21:3323:x1871272568972544:12345-0@lo:103: Request processed in 78us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584698.810324:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584698.810339:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584698.810401:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+20:3320:x1871272568972672:12345-0@lo:103: 00010000:00010000:0.0:1784584698.810411:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584698.810416:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0f07 expref: 20 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.810424:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0f07 expref: 20 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.810446:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584698.810474:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2277b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+20:3320:x1871272568972672:12345-0@lo:103: Request processed in 129us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584698.810480:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584698.810494:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784584698.810501:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568972800:12345-0@lo:103: 00010000:00010000:0.0:1784584698.810508:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584698.810512:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0eeb expref: 19 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.810521:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0eeb expref: 19 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.810530:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584698.810550:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568972800:12345-0@lo:103: Request processed in 49us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584698.810556:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784584698.810599:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2275880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568972800:0@lo:103: 00000100:00100000:0.0:1784584698.810608:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568972672:0@lo:103: 00000100:00100000:0.0:1784584698.810635:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2276680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568972544:0@lo:103: 00010000:00010000:2.0:1784584698.810859:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584698.810980:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584698.810990:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584698.811000:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584698.811008:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568972032 00000100:00100000:1.0:1784584698.811012:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568972032 00000100:00100000:1.0:1784584698.811034:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568972160 00000100:00100000:1.0:1784584698.811036:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568972160 00000100:00100000:1.0:1784584698.811045:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568972288 00000100:00100000:1.0:1784584698.811047:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568972288 00000100:00100000:1.0:1784584698.811055:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568972416 00000100:00100000:1.0:1784584698.811065:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568972416 00000100:00100000:1.0:1784584698.811081:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784584698.811087:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+6:8312:x1871272568972032:12345-0@lo:104: 00010000:00010000:1.0:1784584698.811097:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.811161:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784584698.811166:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+6:8312:x1871272568972032:12345-0@lo:104: Request processed in 80us (2386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584698.811173:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784584698.811187:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784584698.811193:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+5:8312:x1871272568972160:12345-0@lo:104: 00010000:00010000:1.0:1784584698.811201:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.811233:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784584698.811238:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+5:8312:x1871272568972160:12345-0@lo:104: Request processed in 46us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584698.811244:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784584698.811256:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584698.811261:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+4:8312:x1871272568972288:12345-0@lo:104: 00010000:00010000:1.0:1784584698.811268:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.811294:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784584698.811299:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+4:8312:x1871272568972288:12345-0@lo:104: Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584698.811304:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584698.811324:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784584698.811333:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:8312:x1871272568972416:12345-0@lo:104: 00010000:00010000:1.0:1784584698.811340:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811603:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784584698.811611:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811631:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c0031800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584698.811636:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811656:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584698.811664:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584698.811670:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584698.811732:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811739:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584698.811752:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811760:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c0031800/0x787d778cc3ff0edd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ee4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811773:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584698.811776:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811783:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fde00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584698.811786:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811922:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584698.811928:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584698.811934:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584698.811949:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811955:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584698.811961:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811967:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fde00/0x787d778cc3ff0ecf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0ed6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811979:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584698.811982:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811988:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c1513000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584698.811991:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.811998:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584698.812005:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584698.812016:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584698.812032:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.812038:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584698.812049:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.812055:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c1513000/0x787d778cc3ff0ea5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0eac expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.812065:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584698.812066:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584698.812068:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584698.812148:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784584698.812165:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568973184:0@lo:103: 00000100:00100000:0.0:1784584698.812212:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584698.812260:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568972928:0@lo:103: 00000100:00100000:0.0:1784584698.812284:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584698.812312:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784584698.812318:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568973056:0@lo:103: 00000100:00100000:0.0:1784584698.812339:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584698.812428:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568973184 00000100:00100000:0.0:1784584698.812435:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568973184 00010000:00010000:0.0:1784584698.812463:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0ea5 expref: 19 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584698.812481:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568972928 00000100:00100000:0.0:1784584698.812484:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568972928 00010000:00010000:0.0:1784584698.812494:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0edd expref: 20 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584698.812505:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568973056 00000100:00100000:0.0:1784584698.812507:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568973056 00010000:00010000:0.0:1784584698.812517:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0ecf expref: 21 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584698.812529:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784584698.812535:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+21:3321:x1871272568973184:12345-0@lo:103: 00010000:00010000:0.0:1784584698.812548:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584698.812553:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0ea5 expref: 21 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.812564:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0ea5 expref: 21 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.812583:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584698.812615:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+21:3321:x1871272568973184:12345-0@lo:103: Request processed in 79us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584698.812622:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1784584698.812735:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784584698.812742:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+20:3322:x1871272568972928:12345-0@lo:103: 00010000:00010000:0.0:1784584698.812750:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584698.812755:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0edd expref: 20 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.812763:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0edd expref: 20 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.812774:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584698.812928:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784584698.812934:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:8312:x1871272568972416:12345-0@lo:104: Request processed in 1603us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584698.812943:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1784584698.813016:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584698.813023:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.813030:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166e800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584698.813034:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.813042:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584698.813049:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584698.813054:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584698.813083:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.813090:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584698.813097:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.813104:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0e7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e82 expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584698.813131:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584698.813133:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584698.813135:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584698.813148:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1784584698.813157:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1784584698.813221:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+20:3322:x1871272568972928:12345-0@lo:103: Request processed in 479us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584698.813228:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784584698.813243:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1784584698.813250:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568973056:12345-0@lo:103: 00010000:00010000:0.0:1784584698.813259:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584698.813265:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0ecf expref: 19 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.813274:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0ecf expref: 19 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.813286:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584698.813309:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568973056:12345-0@lo:103: Request processed in 60us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584698.813316:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1784584698.813776:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c0030000/0x787d778cc3ff0f38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0f31 expref: 18 pid: 5798 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.813801:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971648:0@lo:104: 00010000:00010000:3.0:1784584698.813953:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1513200/0x787d778cc3ff0f0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0f07 expref: 17 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.813965:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971776:0@lo:104: 00010000:00010000:3.0:1784584698.813977:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c0030600/0x787d778cc3ff0ef2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0eeb expref: 16 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.813985:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971904:0@lo:104: 00010000:00010000:3.0:1784584698.813996:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c166f400/0x787d778cc3ff0ee4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0edd expref: 15 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.814005:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568972032:0@lo:104: 00010000:00010000:3.0:1784584698.814015:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c166e000/0x787d778cc3ff0ed6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0ecf expref: 14 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.814038:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568972160:0@lo:104: 00010000:00010000:3.0:1784584698.814052:0:8312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0eac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0ea5 expref: 13 pid: 5800 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584698.814063:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568972288:0@lo:104: 00000100:00100000:3.0:1784584698.814073:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568972416:0@lo:104: 00000100:00100000:2.0:1784584698.814370:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568973056:0@lo:103: 00000100:00100000:2.0:1784584698.814379:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568972928:0@lo:103: 00010000:00010000:1.0:1784584698.814744:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584698.814890:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584698.814907:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568973312:0@lo:103: 00000100:00100000:2.0:1784584698.814958:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584698.815039:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568973312 00000100:00100000:1.0:1784584698.815047:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568973312 00010000:00010000:1.0:1784584698.815078:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e7b expref: 13 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584698.815115:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784584698.815134:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+13:3320:x1871272568973312:12345-0@lo:103: 00010000:00010000:1.0:1784584698.815148:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584698.815155:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e7b expref: 13 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.815165:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0e7b expref: 13 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.815184:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0e82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0e7b expref: 13 pid: 5799 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.815199:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584698.815232:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f61450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+12:3320:x1871272568973312:12345-0@lo:103: Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584698.815253:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584698.815358:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568973312:0@lo:103: 00000100:00100000:3.0:1784584698.815496:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971392:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584698.815509:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8312:1871272568971520:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584698.815545:0:8312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584698.815911:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568973184:0@lo:103: 00000100:00100000:2.0:1784584698.818200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584698.818393:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549027840 00000100:00100000:0.0:1784584698.818423:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549027840 00010000:00010000:0.0:1784584698.818479:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf7 expref: 10 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584698.818522:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1784584698.818535:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2355:x1871272549027840:12345-192.168.203.52@tcp:103: 00010000:00010000:0.0:1784584698.818556:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584698.818564:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf7 expref: 10 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.818580:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf7 expref: 10 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.818604:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff0f4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf7 expref: 10 pid: 5800 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.818624:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584698.819001:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:2355:x1871272549027840:12345-192.168.203.52@tcp:103: Request processed in 466us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584698.819010:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1784584698.821546:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584698.821686:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549027968 00000100:00100000:1.0:1784584698.821862:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549027968 00010000:00010000:1.0:1784584698.821917:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf0 expref: 9 pid: 5798 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584698.821960:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1784584698.821973:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:2355:x1871272549027968:12345-192.168.203.52@tcp:103: 00010000:00010000:1.0:1784584698.821993:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584698.822001:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf0 expref: 9 pid: 5798 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822016:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf0 expref: 9 pid: 5798 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822040:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2cf0 expref: 9 pid: 5798 timeout: 293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822061:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822071:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822092:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822101:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822141:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822150:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822159:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584698.822164:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.822175:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.831355:0:8312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584698.831382:0:8312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.831420:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.831438:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7faaed200/0x787d778cc3ff0f85 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584698.831468:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584698.833210:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:2355:x1871272549027968:12345-192.168.203.52@tcp:103: Request processed in 10824us (11262us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584698.833244:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:0.0:1784584699.037546:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584699.037665:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549028096 00000100:00100000:3.0:1784584699.037679:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549028096 00000100:00100000:2.0:1784584699.040102:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1784584699.040136:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+8:5570:x1871272549028096:12345-192.168.203.52@tcp:101: 00010000:00010000:2.0:1784584699.040160:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584699.040190:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2d59 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584699.040241:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d59 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584699.040253:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d59 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584699.040264:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fce00, rc 0) 00000100:00100000:2.0:1784584699.040363:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5570:x1871272549028096:12345-192.168.203.52@tcp:101: Request processed in 247us (2833us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584699.045500:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584699.045843:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1784584699.045911:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549028224 00000100:00100000:2.0:1784584699.045921:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549028224 00000100:00100000:3.0:1784584699.047623:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1784584699.047649:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5570:x1871272549028224:12345-192.168.203.52@tcp:501: 00000100:00100000:3.0:1784584699.048167:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5570:x1871272549028224:12345-192.168.203.52@tcp:501: Request processed in 525us (2676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584699.048179:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1784584699.050835:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584699.050962:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549028352 00000100:00100000:1.0:1784584699.050974:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549028352 00000100:00100000:1.0:1784584699.051047:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:1.0:1784584699.051060:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5570:x1871272549028352:12345-192.168.203.52@tcp:503: 00000100:00100000:1.0:1784584699.051377:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5570:x1871272549028352:12345-192.168.203.52@tcp:503: Request processed in 319us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584699.051386:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:0.0:1784584699.056579:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584699.060468:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549028480 00000100:00100000:3.0:1784584699.060488:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549028480 00000100:00100000:3.0:1784584699.060584:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1784584699.060597:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:6034:x1871272549028480:12345-192.168.203.52@tcp:502: 00000100:00100000:3.0:1784584699.061272:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:6034:x1871272549028480:12345-192.168.203.52@tcp:502: Request processed in 674us (4702us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584699.061290:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1784584699.070023:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584699.070207:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549028608 00000100:00100000:2.0:1784584699.070219:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549028608 00000100:00100000:2.0:1784584699.070291:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1784584699.070437:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:6034:x1871272549028608:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784584699.071015:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:6034:x1871272549028608:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 580us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584699.071025:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:2.0:1784584699.083830:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584699.085804:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549028736 00000100:00100000:3.0:1784584699.085824:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549028736 00000100:00100000:3.0:1784584699.085967:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:3.0:1784584699.085980:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5570:x1871272549028736:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584699.086004:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584699.086028:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaeda00/0x787d778cc3ff0f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2d60 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584699.086065:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaeda00/0x787d778cc3ff0f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d60 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584699.086078:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaeda00/0x787d778cc3ff0f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d60 expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584699.086090:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaeda00, rc 0) 00000100:00100000:3.0:1784584699.086200:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5570:x1871272549028736:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 221us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584699.086208:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:0.0:1784584699.088542:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584699.088810:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549028864 00000100:00100000:2.0:1784584699.088823:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549028864 00000100:00100000:2.0:1784584699.089058:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:2.0:1784584699.089070:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5570:x1871272549028864:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584699.089466:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5570:x1871272549028864:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 396us (935us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584699.089476:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00010000:00010000:3.0:1784584699.163982:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584699.932392:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568973440:0@lo:13: 00000100:00100000:3.0:1784584699.932505:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584699.933014:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568973440 00000100:00100000:0.0:1784584699.933025:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568973440 00000100:00100000:0.0:1784584699.933132:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584699.933144:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568973440:12345-0@lo:13: 00002000:00000024:0.0:1784584699.933210:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584699.933270:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568973440:12345-0@lo:13: Request processed in 128us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584699.933278:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1784584699.933892:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784584699.933936:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2277480 x1871272568973440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584715 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584699.933957:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568973440:0@lo:13: 00010000:00010000:1.0:1784584700.188043:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784584700.571780:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784584700.571787:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7fceca000 from 39 10000000:01000000:0.0:1784584700.571793:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784584700.571838:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.571850:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.571861:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584700.571884:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568973568:0@lo:101: 00000100:00100000:0.0:1784584700.571945:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.571997:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.572052:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568973568 00000100:00100000:2.0:1784584700.572059:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568973568 00000100:00100000:2.0:1784584700.572106:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1784584700.572124:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+12:5803:x1871272568973568:12345-0@lo:101: 00010000:00010000:2.0:1784584700.572138:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584700.572151:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0f9a expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.572174:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0f9a expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.572183:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0f9a expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.572192:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fca00, rc 0) 00000100:00100000:2.0:1784584700.572237:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568973568:12345-0@lo:101: Request processed in 114us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.572244:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1784584700.572332:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568973568:0@lo:101: 00010000:00010000:0.0:1784584700.572345:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.572354:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584700.572400:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568973696:0@lo:501: 00000100:00100000:0.0:1784584700.572423:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.572451:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.572494:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568973696 00000100:00100000:2.0:1784584700.572498:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568973696 00000100:00100000:2.0:1784584700.572532:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784584700.572538:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568973696:12345-0@lo:501: 00000100:00100000:2.0:1784584700.572928:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568973696:12345-0@lo:501: Request processed in 389us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.572935:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784584700.573051:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568973696:0@lo:501: 00000100:00100000:2.0:1784584700.573079:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568973824:0@lo:503: 00000100:00100000:2.0:1784584700.573125:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584700.573152:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f57ef3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.573211:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568973824 00000100:00100000:1.0:1784584700.573216:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568973824 00000100:00100000:1.0:1784584700.573246:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1784584700.573252:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568973824:12345-0@lo:503: 00000100:00100000:1.0:1784584700.573403:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568973824:12345-0@lo:503: Request processed in 151us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.573410:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784584700.573510:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568973824:0@lo:503: 00000100:00100000:0.0:1784584700.574084:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8346:1871272568973952:0@lo:502: 00000100:00100000:0.0:1784584700.574133:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.574187:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.574222:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568973952 00000100:00100000:2.0:1784584700.574227:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568973952 00000100:00100000:2.0:1784584700.574286:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1784584700.574294:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:8346:x1871272568973952:12345-0@lo:502: 00000100:00100000:2.0:1784584700.574516:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+13:8346:x1871272568973952:12345-0@lo:502: Request processed in 222us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.574523:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784584700.574727:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8346:1871272568973952:0@lo:502: 00000100:00100000:0.0:1784584700.574767:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8346:1871272568974080:0@lo:502: 00000100:00100000:0.0:1784584700.574800:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.574817:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb600 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.574874:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568974080 00000100:00100000:1.0:1784584700.574879:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568974080 00000100:00100000:1.0:1784584700.574912:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1784584700.574919:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:8346:x1871272568974080:12345-0@lo:502: 00000100:00100000:1.0:1784584700.575046:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:8346:x1871272568974080:12345-0@lo:502: Request processed in 127us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.575052:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1784584700.575143:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8346:1871272568974080:0@lo:502: 00000040:00080000:0.0:1784584700.575161:0:8346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784584700.575284:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784584700.575305:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584700.575314:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.575324:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584700.575333:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1784584700.575335:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1784584700.575337:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784584700.575358:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.575366:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.575380:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.575391:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974208:0@lo:101: 00000100:00100000:1.0:1784584700.575415:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.575442:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020da80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584700.575481:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568974208 00000100:00100000:0.0:1784584700.575485:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568974208 00000100:00100000:0.0:1784584700.575523:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1784584700.575530:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+13:5803:x1871272568974208:12345-0@lo:101: 00010000:00010000:0.0:1784584700.575539:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584700.575550:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bec00/0x787d778cc3ff0faf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0fa8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.575581:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bec00/0x787d778cc3ff0faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0fa8 expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.575590:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bec00/0x787d778cc3ff0faf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0fa8 expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.575599:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bec00, rc 0) 00000100:00100000:0.0:1784584700.575627:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568974208:12345-0@lo:101: Request processed in 97us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.575802:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974208:0@lo:101: 00010000:00010000:1.0:1784584700.575815:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.575822:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.575860:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974336:0@lo:501: 00000100:00100000:1.0:1784584700.575881:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.575893:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020da80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.575903:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568974336 00000100:00100000:1.0:1784584700.575906:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568974336 00000100:00100000:1.0:1784584700.575920:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784584700.575925:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568974336:12345-0@lo:501: 00000100:00100000:1.0:1784584700.576102:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568974336:12345-0@lo:501: Request processed in 176us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.576122:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784584700.576153:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974336:0@lo:501: 00000100:00100000:1.0:1784584700.576174:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974464:0@lo:503: 00000100:00100000:1.0:1784584700.576210:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.576223:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020da80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.576234:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568974464 00000100:00100000:1.0:1784584700.576237:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568974464 00000100:00100000:1.0:1784584700.576253:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784584700.576258:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568974464:12345-0@lo:503: 00000100:00100000:1.0:1784584700.576381:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568974464:12345-0@lo:503: Request processed in 122us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.576387:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784584700.576420:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0736a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974464:0@lo:503: 00000100:00100000:0.0:1784584700.576662:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784584700.576818:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0736a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8347:1871272568974592:0@lo:502: 00000100:00100000:1.0:1784584700.576851:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.576876:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020da80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584700.577163:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568974592 00000100:00100000:0.0:1784584700.577168:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568974592 00000100:00100000:0.0:1784584700.577199:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784584700.577206:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:8347:x1871272568974592:12345-0@lo:502: 00000100:00100000:0.0:1784584700.577346:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:8347:x1871272568974592:12345-0@lo:502: Request processed in 140us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.577352:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1784584700.577387:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0736a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8347:1871272568974592:0@lo:502: 00000020:01000000:0.0:1784584700.577408:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584700.577416:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584700.577419:0:8347:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784584700.577423:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784584700.577443:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8347:1871272568974720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584700.577473:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.577491:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568974720 00000100:00100000:0.0:1784584700.577494:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568974720 00000100:00100000:0.0:1784584700.577510:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784584700.577516:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:8347:x1871272568974720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584700.577770:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:8347:x1871272568974720:12345-0@lo:502:llog_process_th.0 Request processed in 253us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.577776:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1784584700.577803:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020da80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584700.577814:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8347:1871272568974720:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784584700.577832:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584700.577839:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584700.577841:0:8347:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784584700.577844:0:8347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1784584700.577977:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1784584700.577995:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784584700.578003:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.578014:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584700.578023:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784584700.578025:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7c7f3c000 from 39 10000000:01000000:1.0:1784584700.578028:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784584700.578048:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.578056:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.578070:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.578083:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0736300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.578121:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.578140:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4269480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.578154:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568974848 00000100:00100000:1.0:1784584700.578157:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568974848 00000100:00100000:1.0:1784584700.578175:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784584700.578181:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+14:5803:x1871272568974848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584700.578189:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584700.578201:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0fbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0fb6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.578219:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0fb6 expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.578229:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0fbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0fb6 expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.578236:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c166e400, rc 0) 00000100:00100000:1.0:1784584700.578263:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568974848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.578269:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1784584700.578296:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0736300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584700.578308:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.578321:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.578359:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0736300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.578383:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.578396:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4269480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.578407:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568974976 00000100:00100000:1.0:1784584700.578410:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568974976 00000100:00100000:1.0:1784584700.578425:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1784584700.578430:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568974976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.578998:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568974976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 567us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.579005:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784584700.579052:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0736300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568974976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584700.579076:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568975104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584700.579106:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.579171:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b969c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.579201:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568975104 00000100:00100000:1.0:1784584700.579205:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568975104 00000100:00100000:1.0:1784584700.579258:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1784584700.579264:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568975104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.579383:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568975104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.579389:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784584700.579439:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568975104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584700.579976:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8348:1871272568975232:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584700.580013:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.580071:0:8348:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.580101:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568975232 00000100:00100000:1.0:1784584700.580105:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568975232 00000100:00100000:1.0:1784584700.580148:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1784584700.580155:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+15:8348:x1871272568975232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584700.580332:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+15:8348:x1871272568975232:12345-0@lo:502:llog_process_th.0 Request processed in 176us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.580339:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8348:1871272568975232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584700.580344:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784584700.580375:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8348:1871272568975360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584700.580403:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.580417:0:8348:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.580422:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568975360 00000100:00100000:1.0:1784584700.580426:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568975360 00000100:00100000:1.0:1784584700.580451:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1784584700.580456:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:8348:x1871272568975360:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584700.580730:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+15:8348:x1871272568975360:12345-0@lo:502:llog_process_th.0 Request processed in 273us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.580737:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784584700.581245:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8348:1871272568975360:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784584700.581268:0:8348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784584700.581427:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784584700.581448:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584700.581457:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.581468:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584700.581476:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1784584700.581478:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1784584700.581481:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784584700.581504:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.581513:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.581522:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.581536:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0735880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568975488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.581851:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.581878:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d82db780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584700.581958:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568975488 00000100:00100000:3.0:1784584700.581963:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568975488 00000100:00100000:3.0:1784584700.581995:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784584700.582002:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+15:5803:x1871272568975488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584700.582013:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584700.582025:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaec800/0x787d778cc3ff0fcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0fc4 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.582046:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaec800/0x787d778cc3ff0fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0fc4 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.582056:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaec800/0x787d778cc3ff0fcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0fc4 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.582065:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec800, rc 0) 00000100:00100000:3.0:1784584700.582117:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568975488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584700.582123:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1784584700.582207:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0735880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568975488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584700.582221:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.582230:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584700.582272:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568975616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584700.582297:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.582318:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584700.582936:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568975616 00000100:00100000:3.0:1784584700.582941:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568975616 00000100:00100000:3.0:1784584700.582966:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784584700.582972:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568975616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584700.583190:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568975616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 217us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584700.583197:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784584700.583332:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568975616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584700.583364:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568975744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584700.583400:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.583461:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.583492:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568975744 00000100:00100000:1.0:1784584700.583496:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568975744 00000100:00100000:1.0:1784584700.583551:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1784584700.583569:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568975744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.583933:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568975744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 374us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.583940:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784584700.583996:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568975744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584700.584540:0:8350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8350:1871272568975872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584700.584812:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.584846:0:8350:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.584881:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568975872 00000100:00100000:2.0:1784584700.584886:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568975872 00000100:00100000:2.0:1784584700.584944:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1784584700.584951:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+16:8350:x1871272568975872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584700.585122:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+16:8350:x1871272568975872:12345-0@lo:502:llog_process_th.0 Request processed in 156us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.585130:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1784584700.585190:0:8350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8350:1871272568975872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784584700.585211:0:8350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584700.585219:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584700.585221:0:8350:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784584700.585226:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784584700.585245:0:8350:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8350:1871272568976000:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584700.585285:0:8350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.585300:0:8350:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.585353:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568976000 00000100:00100000:1.0:1784584700.585357:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568976000 00000100:00100000:1.0:1784584700.585390:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1784584700.585397:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:8350:x1871272568976000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584700.585525:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:8350:x1871272568976000:12345-0@lo:502:llog_process_th.0 Request processed in 128us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.585531:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784584700.585903:0:8350:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8350:1871272568976000:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584700.585921:0:8350:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584700.585928:0:8350:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584700.585930:0:8350:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784584700.585933:0:8350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1784584700.586042:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1784584700.586059:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784584700.586067:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.586076:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584700.586084:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784584700.586086:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7d687f000 from 39 10000000:01000000:1.0:1784584700.586088:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784584700.586121:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.586134:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.586143:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.586155:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.586180:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.586205:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d023ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.586236:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568976128 00000100:00100000:2.0:1784584700.586240:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568976128 00000100:00100000:2.0:1784584700.586264:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784584700.586270:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568976128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584700.586278:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584700.586288:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0fd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0fd2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.586306:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0fd2 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.586314:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0fd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0fd2 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.586321:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fda00, rc 0) 00000100:00100000:2.0:1784584700.586347:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568976128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.586352:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784584700.586379:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0735c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584700.586389:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.587287:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584700.587341:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584700.587377:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584700.587407:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f57efe40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584700.587452:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568976256 00000100:00100000:0.0:1784584700.587457:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568976256 00000100:00100000:0.0:1784584700.587493:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1784584700.587500:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568976256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584700.588050:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568976256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 550us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.588058:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1784584700.588165:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.588195:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0735500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.588231:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.588258:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d023ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584700.588301:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568976384 00000100:00100000:0.0:1784584700.588305:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568976384 00000100:00100000:0.0:1784584700.588491:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1784584700.588499:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568976384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584700.589205:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568976384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 705us (970us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.589213:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1784584700.589299:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0735500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.591964:0:8352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0735500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8352:1871272568976512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584700.592036:0:8352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.592076:0:8352:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c64d73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.594171:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568976512 00000100:00100000:2.0:1784584700.594181:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568976512 00000100:00100000:2.0:1784584700.594232:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784584700.594241:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:8352:x1871272568976512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584700.594506:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:8352:x1871272568976512:12345-0@lo:502:llog_process_th.0 Request processed in 265us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.594514:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784584700.594816:0:8352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0735500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8352:1871272568976512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584700.594874:0:8352:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8352:1871272568976640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584700.594911:0:8352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584700.594935:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568976640 00000100:00100000:2.0:1784584700.594939:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568976640 00000100:00100000:2.0:1784584700.594961:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784584700.594967:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:8352:x1871272568976640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584700.595094:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:8352:x1871272568976640:12345-0@lo:502:llog_process_th.0 Request processed in 126us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.595101:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784584700.595150:0:8352:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f57ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.595162:0:8352:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8352:1871272568976640:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784584700.595179:0:8352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1784584700.595276:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1784584700.595310:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784584700.595320:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.595331:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584700.595351:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784584700.595354:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1784584700.595357:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784584700.595381:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.595389:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.595397:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.595410:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0736d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.595436:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.595452:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d023ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584700.595552:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568976768 00000100:00100000:0.0:1784584700.595627:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568976768 00000100:00100000:0.0:1784584700.595841:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1784584700.595852:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568976768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584700.595862:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584700.595874:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff0fe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0fe0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.595895:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff0fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0fe0 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.595905:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff0fe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0fe0 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.595914:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfa00, rc 0) 00000100:00100000:0.0:1784584700.595948:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568976768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.595954:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1784584700.596014:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0736d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584700.596027:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.596036:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.596082:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0736d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.596118:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.596141:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d023ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.596933:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568976896 00000100:00100000:2.0:1784584700.596940:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568976896 00000100:00100000:2.0:1784584700.596969:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784584700.596982:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568976896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584700.597235:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568976896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.597242:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784584700.597460:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0736d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568976896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584700.597500:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568977024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584700.597539:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.597890:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568977024 00000100:00100000:1.0:1784584700.597896:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568977024 00000100:00100000:1.0:1784584700.597930:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1784584700.597937:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568977024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.598184:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568977024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 246us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584700.598191:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1784584700.598266:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d867fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784584700.598280:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568977024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.598893:0:8354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8354:1871272568977152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584700.598931:0:8354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.598991:0:8354:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c720a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.599030:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568977152 00000100:00100000:2.0:1784584700.599036:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568977152 00000100:00100000:2.0:1784584700.599100:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784584700.599118:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:8354:x1871272568977152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584700.599298:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:8354:x1871272568977152:12345-0@lo:502:llog_process_th.0 Request processed in 192us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.599305:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1784584700.599373:0:8354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8354:1871272568977152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784584700.599393:0:8354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584700.599402:0:8354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584700.599404:0:8354:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784584700.599410:0:8354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1784584700.599428:0:8354:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8354:1871272568977280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584700.599457:0:8354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584700.599942:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568977280 00000100:00100000:3.0:1784584700.599947:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568977280 00000100:00100000:3.0:1784584700.599968:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784584700.599974:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:8354:x1871272568977280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584700.600134:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:8354:x1871272568977280:12345-0@lo:502:llog_process_th.0 Request processed in 159us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584700.600142:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1784584700.600380:0:8354:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c720a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.600394:0:8354:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8354:1871272568977280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784584700.600413:0:8354:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584700.600417:0:8354:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584700.600419:0:8354:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784584700.600423:0:8354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1784584700.600620:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1784584700.600857:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1784584700.600866:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.600876:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584700.600884:0:5803:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1784584700.600887:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97c7c5d4b380 from 1 10000000:01000000:3.0:1784584700.600889:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784584700.600910:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.600917:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.600930:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584700.600944:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568977408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784584700.600974:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584700.601033:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d867ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.601072:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568977408 00000100:00100000:2.0:1784584700.601076:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568977408 00000100:00100000:2.0:1784584700.601141:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784584700.601148:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568977408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584700.601157:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584700.601169:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c13fdc00/0x787d778cc3ff0ff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff0fee expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.601190:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fdc00/0x787d778cc3ff0ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff0fee expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.601200:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c13fdc00/0x787d778cc3ff0ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0fee expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.601207:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fdc00, rc 0) 00000100:00100000:2.0:1784584700.601246:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568977408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.601257:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1784584700.601311:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568977408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584700.601324:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ff5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.601332:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0ff5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.601373:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568977536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584700.601391:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.601408:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c720a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584700.601421:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568977536 00000100:00100000:2.0:1784584700.601426:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568977536 00000100:00100000:2.0:1784584700.601479:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784584700.601486:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568977536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584700.601724:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568977536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (320us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584700.601731:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1784584700.601867:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568977536:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1784584700.601887:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784584700.601893:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ff5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.601900:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0ff5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1784584700.775271:0:8373:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9683f960 20000000:00000080:1.0:1784584700.775287:0:8373:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c7faaf6000 uarg=0000000000000000 20000000:01000000:1.0:1784584700.775463:0:8373:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784584700.775468:0:8373:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784584700.775472:0:8373:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784584700.776160:0:8374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1784584700.776476:0:8373:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1784584700.782162:0:8373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1784584700.782221:0:8373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1784584700.782297:0:8373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1784584700.782445:0:8373:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784584700.782475:0:8373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.782495:0:8373:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c1513e00/0x787d778cc3ff0d71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0d6a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.782503:0:8373:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0dcc expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.782516:0:8373:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff0e97 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.782525:0:8373:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d28 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.782533:0:8373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.782571:0:8373:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d28 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.782587:0:8373:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d28 expref: 9 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.782601:0:8373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8373:1871272568977664:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584700.782824:0:8373:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0e97 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.782834:0:8373:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0e97 expref: 18 pid: 5800 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.782845:0:8373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8373:1871272568977792:0@lo:104: 00000100:00100000:1.0:1784584700.782883:0:8373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784584700.782918:0:8373:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0dcc expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.782926:0:8373:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0dcc expref: 18 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.782946:0:8373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0737100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8373:1871272568977920:0@lo:104: 00000100:00100000:1.0:1784584700.782971:0:8373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.783004:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784584700.783667:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/3 left), rc = 0 00000100:00100000:3.0:1784584700.783683:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568977792 00000100:00100000:3.0:1784584700.783707:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568977792 00000100:00100000:3.0:1784584700.783743:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568977920 00000100:00100000:3.0:1784584700.783746:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568977920 00000100:00100000:3.0:1784584700.783761:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784584700.783769:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+4:8373:x1871272568977792:12345-0@lo:104: 00010000:00010000:3.0:1784584700.783782:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.783838:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584700.783844:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+4:8373:x1871272568977792:12345-0@lo:104: Request processed in 76us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584700.783850:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784584700.783865:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784584700.783872:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801699450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:8373:x1871272568977920:12345-0@lo:104: 00010000:00010000:3.0:1784584700.783880:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.783911:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784584700.783915:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801699450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:8373:x1871272568977920:12345-0@lo:104: Request processed in 45us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584700.783929:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1784584700.783965:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584700.783971:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.783978:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c0030c00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1784584700.783982:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.783990:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584700.783997:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584700.784003:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784584700.784033:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784039:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584700.784059:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784065:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c0030c00/0x787d778cc3ff0e97 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0e9e expref: -99 pid: 7495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784078:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584700.784081:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784097:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fc800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1784584700.784099:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784116:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584700.784123:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584700.784128:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784584700.784142:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784148:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584700.784165:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784172:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc800/0x787d778cc3ff0dcc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0dd3 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784181:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584700.784183:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584700.784185:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584700.784197:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568978048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584700.784223:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584700.784266:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584700.784274:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568978176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584700.784304:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784584700.784522:0:8373:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c1513e00/0x787d778cc3ff0d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff0d6a expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584700.784532:0:8373:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7c1513e00/0x787d778cc3ff0d71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff0d6a expref: 18 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584700.784541:0:8373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8373:1871272568978304:0@lo:104: 00000100:00100000:1.0:1784584700.784563:0:8373:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584700.784581:0:8373:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010da240 going to sleep for 11 seconds 00000100:00100000:1.0:1784584700.784598:0:8373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8373:1871272568977792:0@lo:104: 00000100:00100000:1.0:1784584700.784605:0:8373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0737100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8373:1871272568977920:0@lo:104: 00000100:00100000:3.0:1784584700.784728:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568978048 00000100:00100000:3.0:1784584700.784733:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568978048 00010000:00010000:3.0:1784584700.784752:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e97 expref: 19 pid: 5800 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584700.784773:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568978176 00000100:00100000:3.0:1784584700.784777:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568978176 00010000:00010000:3.0:1784584700.784787:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0dcc expref: 20 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584700.784806:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784584700.784811:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+20:3323:x1871272568978048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584700.784821:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584700.784826:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0e97 expref: 20 pid: 5800 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784835:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0e97 expref: 20 pid: 5800 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784849:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c0031400/0x787d778cc3ff0e9e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0e97 expref: 20 pid: 5800 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784863:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584700.784891:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272568978048:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584700.784897:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784584700.784911:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784584700.784917:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+18:3321:x1871272568978176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584700.784932:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584700.784937:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0dcc expref: 18 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784945:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0dcc expref: 18 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784955:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c166f800/0x787d778cc3ff0dd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0dcc expref: 18 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.784964:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584700.784990:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+17:3321:x1871272568978176:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584700.784996:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784584700.785027:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568978048:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584700.785045:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568978304 00000100:00100000:3.0:1784584700.785049:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568978304 00000100:00100000:3.0:1784584700.785071:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784584700.785077:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:8373:x1871272568978304:12345-0@lo:104: 00010000:00010000:3.0:1784584700.785085:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.785212:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584700.785444:0:8373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8373:1871272568978304:0@lo:104: 00010000:00010000:3.0:1784584700.785477:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584700.785484:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:8373:x1871272568978304:12345-0@lo:104: Request processed in 406us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584700.785490:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1784584700.785516:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568978176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584700.787584:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584700.787598:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.787622:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166ee00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584700.787626:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.787647:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584700.787655:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584700.787660:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784584700.787733:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.787740:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584700.787756:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.787763:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166ee00/0x787d778cc3ff0d6a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff0d71 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.787779:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584700.787781:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584700.787782:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584700.787928:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584700.787946:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568978432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584700.788005:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584700.788169:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568978432 00000100:00100000:0.0:1784584700.788176:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568978432 00010000:00010000:0.0:1784584700.788207:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c1513e00/0x787d778cc3ff0d71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d6a expref: 17 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584700.788245:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784584700.788387:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+17:3320:x1871272568978432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584700.788400:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584700.788407:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c1513e00/0x787d778cc3ff0d71 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff0d6a expref: 17 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.788418:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c1513e00/0x787d778cc3ff0d71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff0d6a expref: 17 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.788432:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1513e00/0x787d778cc3ff0d71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff0d6a expref: 17 pid: 5798 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584700.788448:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584700.788547:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+16:3320:x1871272568978432:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.788554:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784584700.789383:0:8373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8373:1871272568977664:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584700.789413:0:8373:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584700.791465:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568978432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584700.796037:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584700.796419:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549028992 00000100:00100000:2.0:1784584700.796430:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549028992 00010000:00010000:2.0:1784584700.796471:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d28 expref: 10 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584700.796508:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1784584700.796518:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2355:x1871272549028992:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584700.796532:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584700.796537:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d28 expref: 10 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796549:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d28 expref: 10 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796575:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff0f5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d28 expref: 10 pid: 5798 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796591:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796598:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796614:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796621:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796627:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796644:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796649:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818a00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584700.796653:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796660:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796676:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584700.796889:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584700.796939:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:2355:x1871272549028992:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 422us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584700.796946:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00010000:00010000:3.0:1784584700.797283:0:8373:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.797292:0:8373:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584700.797298:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c801818a00/0x787d778cc3ff0ffc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584700.872793:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584700.872831:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584700.872855:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584700.872883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584700.872909:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549029248 00000100:00100000:0.0:1784584700.872917:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549029248 00000100:00100000:0.0:1784584700.872981:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1784584700.872994:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549029248:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584700.873063:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549029248:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 72us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.873071:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1784584700.873094:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549029376 00000100:00100000:0.0:1784584700.873097:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549029376 00000100:00100000:0.0:1784584700.873145:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549029504 00000100:00100000:0.0:1784584700.873148:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549029504 00000100:00100000:0.0:1784584700.873164:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1784584700.873169:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549029376:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584700.873195:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549029376:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.873201:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1784584700.873213:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1784584700.873218:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549029504:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584700.873238:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549029504:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 20us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584700.873243:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:0.0:1784584700.873269:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784584700.873273:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784584700.873275:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584700.874050:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549029120 00000100:00100000:3.0:1784584700.874059:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549029120 00000100:00100000:3.0:1784584700.874091:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:3.0:1784584700.874099:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:2355:x1871272549029120:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584700.874155:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:2355:x1871272549029120:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 57us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584700.874162:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 168 00010000:00010000:0.0:1784584701.212501:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784584701.662196:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784584701.662204:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7fceca000 from 4 10000000:01000000:2.0:1784584701.662209:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584701.662256:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.662268:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.662279:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584701.663422:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568978560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.663498:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.663561:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f1cfe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584701.667173:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568978560 00000100:00100000:1.0:1784584701.667190:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568978560 00000100:00100000:1.0:1784584701.667283:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1784584701.667294:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568978560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584701.667313:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584701.667338:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff1003 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584701.667388:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff1003 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584701.667399:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1003 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584701.667409:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819e00, rc 0) 00000100:00100000:1.0:1784584701.667486:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568978560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584701.667493:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784584701.668147:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568978560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584701.668168:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.668178:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584701.668261:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568978688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.668312:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.668356:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f1cfe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584701.668492:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568978688 00000100:00100000:1.0:1784584701.668498:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568978688 00000100:00100000:1.0:1784584701.668535:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1784584701.668543:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568978688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584701.669336:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568978688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 792us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584701.669345:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1784584701.670969:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568978688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.671037:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568978816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.671115:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.671159:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f1cfe0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584701.672591:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568978816 00000100:00100000:1.0:1784584701.672603:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568978816 00000100:00100000:1.0:1784584701.672722:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784584701.672733:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568978816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584701.672961:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568978816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 230us (1845us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584701.672969:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784584701.673991:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568978816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.674262:0:8397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8397:1871272568978944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584701.674318:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.674350:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568978944 00000100:00100000:2.0:1784584701.674355:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568978944 00000100:00100000:2.0:1784584701.674406:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784584701.674413:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:8397:x1871272568978944:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584701.674983:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:8397:x1871272568978944:12345-0@lo:502:llog_process_th.0 Request processed in 567us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584701.674992:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1784584701.675048:0:8397:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d0722480 going to sleep for 11 seconds 00000100:00100000:2.0:1784584701.675066:0:8397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8397:1871272568978944:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584701.675092:0:8397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584701.675109:0:8397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584701.675112:0:8397:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784584701.675119:0:8397:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7fceca000 00000020:00000080:2.0:1784584701.675122:0:8397:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784584701.675197:0:8397:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8397:1871272568979072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584701.675232:0:8397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.675253:0:8397:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d0722480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584701.676908:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568979072 00000100:00100000:1.0:1784584701.676919:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568979072 00000100:00100000:1.0:1784584701.676971:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1784584701.676981:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:8397:x1871272568979072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584701.677208:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:8397:x1871272568979072:12345-0@lo:502:llog_process_th.0 Request processed in 228us (1974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584701.677217:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784584701.677420:0:8397:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8397:1871272568979072:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584701.677453:0:8397:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584701.677459:0:8397:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584701.677462:0:8397:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784584701.677466:0:8397:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784584701.677523:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784584701.677537:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584701.677556:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.677567:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584701.677577:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784584701.677580:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7c7f3c000 from 4 10000000:01000000:2.0:1784584701.677582:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584701.677611:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.677619:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.677627:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584701.677643:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.677949:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.677978:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d0722480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584701.678417:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568979200 00000100:00100000:1.0:1784584701.678423:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568979200 00000100:00100000:1.0:1784584701.678465:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1784584701.678473:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568979200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584701.678484:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584701.678497:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff1011 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584701.678520:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff1011 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584701.678530:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1011 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584701.678554:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818000, rc 0) 00000100:00100000:1.0:1784584701.678594:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568979200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584701.678599:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784584701.683176:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584701.683218:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.683231:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584701.683325:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.683386:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.683431:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d0722480 going to sleep for 11 seconds 00000100:00100000:2.0:1784584701.683457:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568979328 00000100:00100000:2.0:1784584701.683463:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568979328 00000100:00100000:2.0:1784584701.683520:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784584701.683528:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568979328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.683955:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568979328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 426us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584701.683963:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1784584701.685812:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.685885:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.685958:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.685985:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d0722480 going to sleep for 11 seconds 00000100:00100000:0.0:1784584701.686824:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568979456 00000100:00100000:0.0:1784584701.686833:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568979456 00000100:00100000:0.0:1784584701.686882:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1784584701.686891:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568979456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584701.687207:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568979456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (1248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584701.687216:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784584701.687974:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.692333:0:8398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8398:1871272568979584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584701.692428:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.692469:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568979584 00000100:00100000:2.0:1784584701.692475:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568979584 00000100:00100000:2.0:1784584701.692523:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784584701.692531:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:8398:x1871272568979584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584701.692751:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:8398:x1871272568979584:12345-0@lo:502:llog_process_th.0 Request processed in 220us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584701.692759:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784584701.692811:0:8398:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4269c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584701.692835:0:8398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8398:1871272568979584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584701.692864:0:8398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584701.692874:0:8398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584701.692877:0:8398:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784584701.692888:0:8398:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7c7f3c000 00000020:00000080:2.0:1784584701.692891:0:8398:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784584701.692965:0:8398:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8398:1871272568979712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584701.692999:0:8398:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.693009:0:8398:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4246900 going to sleep for 11 seconds 00000100:00100000:3.0:1784584701.697169:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568979712 00000100:00100000:3.0:1784584701.697184:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568979712 00000100:00100000:3.0:1784584701.697577:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784584701.697589:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:8398:x1871272568979712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584701.697862:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:8398:x1871272568979712:12345-0@lo:502:llog_process_th.0 Request processed in 273us (4860us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584701.697871:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1784584701.702286:0:8398:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8398:1871272568979712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784584701.702339:0:8398:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584701.702347:0:8398:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584701.702349:0:8398:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784584701.702354:0:8398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784584701.706483:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784584701.706518:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584701.706530:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.706542:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584701.706554:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784584701.706557:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7d687f000 from 4 10000000:01000000:2.0:1784584701.706559:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584701.706611:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.706645:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584701.706657:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584701.706680:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584701.706767:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584701.706806:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4246c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584701.710401:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568979840 00000100:00100000:0.0:1784584701.710415:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568979840 00000100:00100000:0.0:1784584701.710463:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784584701.710474:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568979840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584701.710498:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584701.710519:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff101f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584701.710546:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff101f expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584701.710557:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff101f expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584701.710566:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be800, rc 0) 00000100:00100000:0.0:1784584701.710659:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568979840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (3882us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584701.710666:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784584701.712804:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584701.712832:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584701.712845:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584701.712924:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584701.712975:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584701.713020:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8b96180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584701.713116:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568979968 00000100:00100000:1.0:1784584701.713123:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568979968 00000100:00100000:1.0:1784584701.713169:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784584701.713179:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568979968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584701.713428:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568979968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584701.713443:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1784584701.713481:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568979968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584701.713510:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568980096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584701.713548:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584701.713565:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010da9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584701.713578:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568980096 00000100:00100000:1.0:1784584701.713582:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568980096 00000100:00100000:1.0:1784584701.713604:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784584701.713610:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568980096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584701.713831:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568980096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584701.713838:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1784584701.713876:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568980096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584701.746904:0:8402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8402:1871272568980224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584701.746995:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584701.747051:0:8402:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584701.748758:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568980224 00000100:00100000:1.0:1784584701.748770:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568980224 00000100:00100000:1.0:1784584701.748821:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784584701.748830:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:8402:x1871272568980224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584701.749067:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:8402:x1871272568980224:12345-0@lo:502:llog_process_th.0 Request processed in 237us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584701.749075:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784584701.749148:0:8402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8402:1871272568980224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784584701.749179:0:8402:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584701.749188:0:8402:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584701.749190:0:8402:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1784584701.749202:0:8402:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7d687f000 00000020:00000080:1.0:1784584701.749204:0:8402:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784584701.749287:0:8402:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8402:1871272568980352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584701.749323:0:8402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584701.749342:0:8402:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010da180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584701.749356:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568980352 00000100:00100000:1.0:1784584701.749359:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568980352 00000100:00100000:1.0:1784584701.749377:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784584701.749382:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:8402:x1871272568980352:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584701.749485:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:8402:x1871272568980352:12345-0@lo:502:llog_process_th.0 Request processed in 101us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584701.749492:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1784584701.749527:0:8402:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:8402:1871272568980352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784584701.749544:0:8402:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584701.749548:0:8402:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584701.749549:0:8402:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1784584701.749553:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784584701.750420:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784584701.750446:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784584701.750456:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584701.750468:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584702.029491:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584702.029566:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549029632 00000100:00100000:1.0:1784584702.029575:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549029632 00000100:00100000:1.0:1784584702.029630:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:1.0:1784584702.029640:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:5570:x1871272549029632:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584702.029668:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584702.029687:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2d67 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584702.030027:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d67 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584702.030052:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d67 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584702.030061:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818e00, rc 0) 00000100:00100000:1.0:1784584702.030127:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5570:x1871272549029632:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 489us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584702.030134:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:1.0:1784584702.042054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584702.042788:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549029760 00000100:00100000:3.0:1784584702.042798:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549029760 00000100:00100000:3.0:1784584702.042857:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:3.0:1784584702.042867:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5570:x1871272549029760:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584702.043164:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5570:x1871272549029760:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 297us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584702.043172:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:0.0:1784584702.060924:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584702.060982:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549029888 00000100:00100000:2.0:1784584702.060992:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549029888 00000100:00100000:2.0:1784584702.061046:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:2.0:1784584702.061057:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5570:x1871272549029888:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584702.061273:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:5570:x1871272549029888:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 217us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584702.061281:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:1.0:1784584702.070147:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584702.070532:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549030016 00000100:00100000:2.0:1784584702.070542:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549030016 00000100:00100000:2.0:1784584702.070605:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:2.0:1784584702.070615:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:6091:x1871272549030016:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784584702.070895:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:6091:x1871272549030016:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 281us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584702.070904:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:0.0:1784584702.075885:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584702.076041:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549030144 00000100:00100000:3.0:1784584702.076050:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549030144 00000100:00100000:3.0:1784584702.076115:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:3.0:1784584702.076125:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:6091:x1871272549030144:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584702.076437:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:6091:x1871272549030144:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 312us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584702.076445:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 188 00010000:00010000:3.0:1784584702.236987:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584703.003909:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568980480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584703.003996:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584703.004159:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568980480 00000100:00100000:2.0:1784584703.004166:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568980480 00000100:00100000:2.0:1784584703.004227:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584703.004235:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568980480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584703.004269:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584703.004313:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568980480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584703.004319:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584703.004494:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568980736:0@lo:400:kworker.0 00000100:00100000:2.0:1784584703.004537:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584703.004562:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584703.004567:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568980864:0@lo:400:kworker.0 00000100:00100000:2.0:1784584703.004590:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584703.004615:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568980736 00000100:00100000:2.0:1784584703.004619:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568980736 00000100:00100000:2.0:1784584703.004641:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568980864 00000100:00100000:2.0:1784584703.004644:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568980864 00000100:00100000:2.0:1784584703.004662:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584703.004669:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568980736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584703.004732:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568980736:12345-0@lo:400:kworker.0 Request processed in 63us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584703.004738:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584703.004751:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784584703.004757:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568980864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584703.004795:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568980864:12345-0@lo:400:kworker.0 Request processed in 38us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584703.004801:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784584703.004852:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568980864:0@lo:400:kworker.0 00000100:00100000:2.0:1784584703.004871:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568980736:0@lo:400:kworker.0 00000100:00100000:0.0:1784584703.005085:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568980608:0@lo:400:kworker.0 00000100:00100000:0.0:1784584703.005132:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584703.005166:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568981120:0@lo:400:kworker.0 00000100:00100000:0.0:1784584703.005186:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584703.005203:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584703.005207:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568980992:0@lo:400:kworker.0 00000100:00100000:0.0:1784584703.005227:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584703.005251:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568980992 00000100:00100000:0.0:1784584703.005255:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568980992 00000100:00100000:0.0:1784584703.005283:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584703.005289:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568980992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584703.005321:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568980992:12345-0@lo:400:kworker.0 Request processed in 32us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584703.005326:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1784584703.005352:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7c40f7b80 x1871272568980992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584703.005362:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568980992:0@lo:400:kworker.0 00000100:00100000:0.0:1784584703.005377:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568981120 00000100:00100000:0.0:1784584703.005379:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568981120 00000100:00100000:0.0:1784584703.005398:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784584703.005404:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568981120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584703.005433:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568981120:12345-0@lo:400:kworker.0 Request processed in 29us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584703.005438:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784584703.005459:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568981120:0@lo:400:kworker.0 00000100:00080000:3.0:1784584703.005576:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584703.005581:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784584703.005583:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784584703.005603:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b1ce00 x1871272568980480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584719 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584703.005619:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568980480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584703.005684:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568980608 00000100:00100000:2.0:1784584703.005759:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568980608 00000100:00100000:2.0:1784584703.005790:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1784584703.005795:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272568980608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584703.005834:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272568980608:12345-0@lo:400:kworker.0 Request processed in 39us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584703.005839:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1784584703.006140:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568980608:0@lo:400:kworker.0 00010000:00010000:0.0:1784584703.262018:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584704.284104:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584705.074009:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568981248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584705.074112:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584705.074205:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568981248 00000100:00100000:0.0:1784584705.074215:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568981248 00000100:00100000:0.0:1784584705.074275:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584705.074284:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568981248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784584705.074328:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584705.074377:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568981248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584705.074385:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1784584705.074431:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2277b80 x1871272568981248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584705.074451:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568981248:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784584705.074594:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784584705.316961:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584705.987034:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584705.987086:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584705.987120:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584705.987158:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584705.987194:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549030656 00000100:00100000:3.0:1784584705.987205:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549030656 00000100:00100000:3.0:1784584705.987276:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549030528 00000100:00100000:3.0:1784584705.987280:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549030528 00000100:00100000:3.0:1784584705.987308:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1784584705.987320:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549030656:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584705.987411:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549030656:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 93us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584705.987421:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1784584705.987440:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1784584705.987447:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549030528:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584705.987469:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549030528:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584705.987489:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1784584705.987511:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549030272 00000100:00100000:3.0:1784584705.987514:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549030272 00000100:00100000:3.0:1784584705.987544:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:3.0:1784584705.987550:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2357:x1871272549030272:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584705.987576:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2357:x1871272549030272:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584705.987582:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00080000:3.0:1784584705.987624:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584705.987630:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784584705.988225:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549030400 00000100:00100000:1.0:1784584705.988231:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549030400 00000100:00100000:1.0:1784584705.988300:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:1.0:1784584705.988308:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549030400:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584705.988355:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549030400:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 48us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584705.988362:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00080000:3.0:1784584705.989730:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784584706.338606:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584707.366266:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584708.125513:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568981376:0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.125613:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584708.125670:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568981888:0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.125720:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584708.125750:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584708.125756:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568981760:0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.125784:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584708.125812:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568981504:0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.125836:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584708.125852:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568982016:0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.125891:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584708.125913:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584708.125919:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272568981632:0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.125952:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584708.125988:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568981376 00000100:00100000:3.0:1784584708.125996:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568981376 00000100:00100000:3.0:1784584708.126052:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784584708.126074:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568981376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.126136:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568981376:12345-0@lo:400:kworker.0 Request processed in 75us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584708.126145:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1784584708.126183:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568981760 00000100:00100000:3.0:1784584708.126187:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568981760 00000100:00100000:3.0:1784584708.126218:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568982016 00000100:00100000:3.0:1784584708.126221:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568982016 00000100:00100000:3.0:1784584708.126238:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584708.126244:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568981760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.126276:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568981760:12345-0@lo:400:kworker.0 Request processed in 32us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584708.126283:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584708.126293:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584708.126299:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568982016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.126326:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568982016:12345-0@lo:400:kworker.0 Request processed in 27us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584708.126332:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584708.126349:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568981888 00000100:00100000:3.0:1784584708.126353:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568981888 00000100:00100000:3.0:1784584708.126378:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568981504 00000100:00100000:3.0:1784584708.126381:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568981504 00000100:00100000:3.0:1784584708.126390:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568981632 00000100:00100000:3.0:1784584708.126393:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568981632 00000100:00100000:3.0:1784584708.126416:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784584708.126421:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568981888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.126453:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568981888:12345-0@lo:400:kworker.0 Request processed in 31us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584708.126458:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784584708.126470:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784584708.126475:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568981504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.126499:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568981504:12345-0@lo:400:kworker.0 Request processed in 24us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584708.126505:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784584708.126515:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784584708.126520:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272568981632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.126544:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272568981632:12345-0@lo:400:kworker.0 Request processed in 24us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584708.126550:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1784584708.126575:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784584708.126580:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784584708.126583:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584708.126618:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272568981632:0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.126630:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568981504:0@lo:400:kworker.0 00010000:00080000:3.0:1784584708.126643:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7efeb0700 x1871272568982016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584708.126653:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568982016:0@lo:400:kworker.0 00010000:00080000:3.0:1784584708.126685:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7efeb1880 x1871272568981760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584724 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584708.126733:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568981760:0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.126746:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568981376:0@lo:400:kworker.0 00000100:00100000:3.0:1784584708.126756:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568981888:0@lo:400:kworker.0 00000100:00100000:0.0:1784584708.127009:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568982144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584708.127052:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584708.127107:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568982144 00000100:00100000:0.0:1784584708.127113:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568982144 00000100:00100000:0.0:1784584708.127144:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784584708.127150:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568982144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584708.127187:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584708.127228:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568982144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584708.127235:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1784584708.127276:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2277b80 x1871272568982144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584724 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584708.127292:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2277b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568982144:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1784584708.380531:0:8672:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1784584708.383323:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584709.405733:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584710.180865:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568982272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584710.180940:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584710.181452:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568982272 00000100:00100000:2.0:1784584710.181461:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568982272 00000100:00100000:2.0:1784584710.181531:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584710.181542:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568982272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584710.181578:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584710.181634:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568982272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584710.181642:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1784584710.181854:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784584710.181885:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7d0734700 x1871272568982272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584710.181905:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568982272:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784584710.428173:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584711.119106:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584711.123096:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584711.123224:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584711.123260:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584711.123343:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549030912 00000100:00100000:3.0:1784584711.123353:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549030912 00000100:00100000:3.0:1784584711.123445:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1784584711.123455:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549030912:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584711.123521:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549030912:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 68us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584711.123530:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1784584711.125874:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549031040 00000100:00100000:3.0:1784584711.125921:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549031040 00000100:00100000:3.0:1784584711.125974:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549031168 00000100:00100000:3.0:1784584711.125978:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549031168 00000100:00100000:3.0:1784584711.126056:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1784584711.126067:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549031040:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584711.126128:0:6607:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784584711.126139:0:6607:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1784584711.128260:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549031040:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 2186us (5164us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584711.128273:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1784584711.128361:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1784584711.128372:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549031168:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584711.130116:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549030784 00000100:00100000:1.0:1784584711.130128:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549030784 00000100:00100000:1.0:1784584711.130257:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:1.0:1784584711.130267:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2355:x1871272549030784:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:2.0:1784584711.134112:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584711.134121:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584711.134124:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584711.140954:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549031168:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 12573us (17681us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584711.140970:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1784584711.144267:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2355:x1871272549030784:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 13992us (25161us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584711.144283:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00010000:00010000:3.0:1784584711.457941:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584712.476325:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784584713.229348:0:8917:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing yml_node 00000100:00100000:2.0:1784584713.244295:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff81aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568982784:0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.244369:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584713.244428:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784584713.244436:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff81b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568982400:0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.244470:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584713.244508:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff81a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272568982912:0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.244567:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584713.244598:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff81a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568982528:0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.244623:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584713.244643:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568983040:0@lo:400:kworker.0 00000100:00100000:0.0:1784584713.244656:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff81bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568982656:0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.244668:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584713.244732:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584713.244735:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568982784 00000100:00100000:2.0:1784584713.244743:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568982784 00000100:00100000:2.0:1784584713.244798:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568983040 00000100:00100000:2.0:1784584713.244802:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568983040 00000100:00100000:0.0:1784584713.244806:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568982912 00000100:00100000:0.0:1784584713.244811:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568982912 00000100:00100000:2.0:1784584713.244834:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784584713.244844:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568982784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584713.244847:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568982528 00000100:00100000:0.0:1784584713.244851:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568982528 00000100:00100000:0.0:1784584713.244865:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568982656 00000100:00100000:0.0:1784584713.244867:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568982656 00000100:00100000:0.0:1784584713.244886:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784584713.244894:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272568982912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.244905:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568982784:12345-0@lo:400:kworker.0 Request processed in 61us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584713.244913:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784584713.244934:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784584713.244939:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272568982912:12345-0@lo:400:kworker.0 Request processed in 44us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584713.244944:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568983040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584713.244951:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784584713.244971:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584713.244980:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568982528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.244986:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568983040:12345-0@lo:400:kworker.0 Request processed in 45us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584713.244994:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584713.245018:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568982400 00000100:00100000:0.0:1784584713.245020:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568982528:12345-0@lo:400:kworker.0 Request processed in 40us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584713.245023:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568982400 00000100:00100000:0.0:1784584713.245040:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584713.245059:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584713.245067:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568982656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.245071:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1784584713.245084:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568982400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584713.245107:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568982656:12345-0@lo:400:kworker.0 Request processed in 40us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584713.245121:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784584713.245126:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568982400:12345-0@lo:400:kworker.0 Request processed in 44us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584713.245144:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1784584713.245149:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568983168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584713.245184:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784584713.245189:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584713.245196:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584713.245199:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584713.245223:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff81bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568982656:0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.245234:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff81b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568982400:0@lo:400:kworker.0 00000100:00100000:2.0:1784584713.245253:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff81a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272568982912:0@lo:400:kworker.0 00000100:00100000:0.0:1784584713.245255:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568983168 00000100:00100000:0.0:1784584713.245260:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568983168 00010000:00080000:2.0:1784584713.245268:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ff81aa00 x1871272568982784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584713.245281:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff81aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568982784:0@lo:400:kworker.0 00000100:00100000:0.0:1784584713.245289:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784584713.245297:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568983168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584713.245325:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584713.245369:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568983168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584713.245375:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1784584713.245401:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff81a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568982528:0@lo:400:kworker.0 00010000:00080000:0.0:1784584713.245412:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ff819880 x1871272568983040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584713.245422:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff819880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568983040:0@lo:400:kworker.0 00010000:00080000:2.0:1784584713.246217:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2275c00 x1871272568983168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584713.246234:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568983168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784584713.502309:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584714.536818:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584715.292799:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784584715.292832:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568983296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584715.292926:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584715.293120:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568983296 00000100:00100000:3.0:1784584715.293130:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568983296 00000100:00100000:3.0:1784584715.293205:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784584715.293216:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568983296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584715.293262:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584715.293317:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2277800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568983296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584715.293325:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1784584715.293526:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784584715.293570:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2275c00 x1871272568983296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584715.293663:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568983296:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784584715.548047:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584716.255966:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584716.256017:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584716.256049:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584716.256079:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584716.256084:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549031424 00000100:00100000:0.0:1784584716.256095:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549031424 00000100:00100000:2.0:1784584716.256106:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549031552 00000100:00100000:2.0:1784584716.256112:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549031552 00000100:00100000:2.0:1784584716.256159:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549031680 00000100:00100000:2.0:1784584716.256162:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549031680 00000100:00100000:0.0:1784584716.256167:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1784584716.256180:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549031424:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584716.256190:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1784584716.256199:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2353:x1871272549031552:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:2.0:1784584716.256227:0:6607:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0f69 00000100:00080000:2.0:1784584716.256236:0:6607:0:(import.c:65:import_set_state_nolock()) ffff97c7c5ee0800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784584716.256258:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549031424:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584716.256266:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000001:00000004:2.0:1784584716.256274:0:6607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:0.0:1784584716.256387:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784584716.256393:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784584716.256396:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784584716.256405:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584716.256441:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1784584716.256452:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2353:x1871272549031680:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:0.0:1784584716.256472:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0f70 00000100:00080000:0.0:1784584716.256480:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7c5ee3000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784584716.256503:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1784584716.256792:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+2:2353:x1871272549031680:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 342us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584716.256799:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00010000:00010000:0.0:1784584716.256816:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584716.256854:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549031296 00000100:00100000:1.0:1784584716.256872:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549031296 00000100:00100000:1.0:1784584716.256920:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:1.0:1784584716.256928:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549031296:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584716.256958:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549031296:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584716.256964:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:2.0:1784584716.260114:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+2:2353:x1871272549031552:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 3906us (4053us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584716.260129:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00010000:00010000:0.0:1784584716.576918:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584717.605405:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784584717.930379:0:9110:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.183 00000100:00100000:2.0:1784584718.363940:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568983808:0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364020:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584718.364084:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784584718.364091:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568983424:0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364120:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584718.364142:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272568983936:0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364166:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584718.364190:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff81b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568983680:0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364212:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584718.364228:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784584718.364234:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568983552:0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364256:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584718.364274:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568984064:0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364293:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584718.364334:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568983808 00000100:00100000:2.0:1784584718.364341:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568983808 00000100:00100000:2.0:1784584718.364388:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568984064 00000100:00100000:2.0:1784584718.364391:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568984064 00000100:00100000:2.0:1784584718.364412:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584718.364421:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568983808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364468:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568983808:12345-0@lo:400:kworker.0 Request processed in 47us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584718.364489:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784584718.364505:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584718.364510:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568984064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364554:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568984064:12345-0@lo:400:kworker.0 Request processed in 43us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584718.364560:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584718.364578:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568983424 00000100:00100000:2.0:1784584718.364580:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568983424 00000100:00100000:2.0:1784584718.364606:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784584718.364612:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568983424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364639:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568983424:12345-0@lo:400:kworker.0 Request processed in 28us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584718.364660:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1784584718.364686:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568983936 00000100:00100000:2.0:1784584718.364689:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568983936 00000100:00100000:2.0:1784584718.364737:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568983680 00000100:00100000:2.0:1784584718.364740:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568983680 00000100:00100000:2.0:1784584718.364753:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568983552 00000100:00100000:2.0:1784584718.364756:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568983552 00000100:00100000:2.0:1784584718.364769:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584718.364775:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272568983936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364806:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272568983936:12345-0@lo:400:kworker.0 Request processed in 32us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584718.364812:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584718.364823:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784584718.364829:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568983680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364867:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568983680:12345-0@lo:400:kworker.0 Request processed in 38us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584718.364873:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784584718.364885:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584718.364890:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568983552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.364916:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568983552:12345-0@lo:400:kworker.0 Request processed in 26us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584718.364922:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1784584718.364946:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584718.364950:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584718.364952:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584718.364990:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568983552:0@lo:400:kworker.0 00010000:00080000:2.0:1784584718.365013:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ff818000 x1871272568984064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584718.365023:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568984064:0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.365034:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff81b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568983680:0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.365062:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff818e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568983424:0@lo:400:kworker.0 00000100:00100000:2.0:1784584718.365072:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272568983936:0@lo:400:kworker.0 00010000:00080000:2.0:1784584718.365081:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ff818a80 x1871272568983808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584734 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584718.365090:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff818a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568983808:0@lo:400:kworker.0 00000100:00100000:0.0:1784584718.365544:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784584718.365555:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568984192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584718.365588:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584718.370801:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568984192 00000100:00100000:1.0:1784584718.370817:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568984192 00000100:00100000:1.0:1784584718.370933:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784584718.370944:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568984192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584718.371000:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584718.371100:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568984192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (5511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584718.371108:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1784584718.371142:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2275c00 x1871272568984192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584734 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584718.371183:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568984192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1784584718.619871:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584719.644303:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784584719.928173:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:3.0:1784584719.928182:0:6631:0:(genops.c:906:class_export_put()) final put ffff97c7c5ee1800/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:2.0:1784584719.928581:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c5ee1800/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 for lustre-OST0000 00000020:00000080:2.0:1784584719.928640:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7c5ee0800 for lustre-OST0000 00000100:00100000:3.0:1784584720.413245:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584720.413268:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568984320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584720.413334:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584720.413391:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568984320 00000100:00100000:3.0:1784584720.413397:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568984320 00000100:00100000:3.0:1784584720.413463:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1784584720.413472:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568984320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584720.413506:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584720.413998:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568984320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 525us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584720.414007:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1784584720.414029:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784584720.414058:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2abe680 x1871272568984320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584720.414075:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2abe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568984320:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1784584720.464879:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:0.0:1784584720.465039:0:7511:0:(genops.c:906:class_export_put()) final put ffff97c7c5ee5800/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:2.0:1784584720.465122:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c5ee5800/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 for lustre-OST0001 00000020:00000080:2.0:1784584720.465231:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7c5ee3000 for lustre-OST0001 00000001:02000400:1.0:1784584720.535221:0:9209:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.183 00010000:00010000:0.0:1784584720.667948:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584721.348236:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584721.348401:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549031808 00000100:00100000:0.0:1784584721.348410:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549031808 00000100:00100000:0.0:1784584721.348467:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:0.0:1784584721.348476:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2355:x1871272549031808:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584721.348593:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2355:x1871272549031808:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 117us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584721.348602:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:3.0:1784584721.348962:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584721.355486:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549031936 00000100:00100000:1.0:1784584721.355511:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549031936 00000100:00080000:0.0:1784584721.355671:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584721.355758:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1784584721.355770:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549031936:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584721.355849:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549031936:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 82us (6887us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584721.355859:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00010000:00010000:2.0:1784584721.693048:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584722.719672:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784584722.830055:0:9306:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.183 00000100:00100000:3.0:1784584723.483988:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568984576:0@lo:400:kworker.0 00000100:00100000:2.0:1784584723.483998:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568984832:0@lo:400:kworker.0 00000100:00100000:1.0:1784584723.484054:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568984448:0@lo:400:kworker.0 00000100:00100000:0.0:1784584723.484919:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568984704:0@lo:400:kworker.0 00000100:00100000:2.0:1784584723.488805:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584723.488890:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568984832 00000100:00100000:2.0:1784584723.488898:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568984832 00000100:00100000:2.0:1784584723.488954:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584723.488978:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568984832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584723.489034:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568984832:12345-0@lo:400:kworker.0 Request processed in 71us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584723.489042:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1784584723.489060:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784584723.489089:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2abdc00 x1871272568984832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584723.489104:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2abdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568984832:0@lo:400:kworker.0 00000100:00100000:1.0:1784584723.489432:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584723.489461:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568984960:0@lo:400:kworker.0 00000100:00100000:1.0:1784584723.489492:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584723.489541:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568984960 00000100:00100000:1.0:1784584723.489546:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568984960 00000100:00100000:1.0:1784584723.489580:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784584723.489586:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568984960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584723.489623:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568984960:12345-0@lo:400:kworker.0 Request processed in 37us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584723.489629:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1784584723.489645:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584723.489671:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2abd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568984960:0@lo:400:kworker.0 00000100:00100000:2.0:1784584723.490739:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568984448 00000100:00100000:2.0:1784584723.490748:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568984448 00000100:00100000:2.0:1784584723.490849:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1784584723.490860:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568984448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584723.490922:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568984448:12345-0@lo:400:kworker.0 Request processed in 65us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584723.490929:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1784584723.493244:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584723.493359:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568985088:0@lo:400:kworker.0 00000100:00100000:3.0:1784584723.493399:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584723.493467:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568984576 00000100:00100000:3.0:1784584723.493474:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568984576 00000100:00100000:3.0:1784584723.493516:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784584723.493524:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568984576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584723.493576:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568984576:12345-0@lo:400:kworker.0 Request processed in 52us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584723.493583:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784584723.493604:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568985088 00000100:00100000:3.0:1784584723.493607:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568985088 00000100:00100000:3.0:1784584723.493641:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784584723.493648:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568985088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584723.493680:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568985088:12345-0@lo:400:kworker.0 Request processed in 33us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584723.493686:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1784584723.493726:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584723.493773:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2abe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568984576:0@lo:400:kworker.0 00010000:00080000:3.0:1784584723.493788:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2abed80 x1871272568985088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584739 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584723.493798:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2abed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568985088:0@lo:400:kworker.0 00000100:00100000:3.0:1784584723.493849:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2abea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568984448:0@lo:400:kworker.0 00000100:00100000:0.0:1784584723.494255:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584723.494390:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568985216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584723.494420:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584723.494454:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568985216 00000100:00100000:0.0:1784584723.494458:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568985216 00000100:00100000:0.0:1784584723.494486:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784584723.494493:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568985216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584723.494523:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584723.494559:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568985216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584723.494565:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1784584723.494595:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b0d180 x1871272568985216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584739 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584723.494627:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568985216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584723.494686:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568984704 00000100:00100000:3.0:1784584723.494837:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568984704 00000100:00100000:3.0:1784584723.496197:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784584723.496207:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568984704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584723.496478:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568984704:12345-0@lo:400:kworker.0 Request processed in 271us (2294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584723.496499:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784584723.496765:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568984704:0@lo:400:kworker.0 00000100:00080000:0.0:1784584723.496894:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784584723.743488:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784584724.716401:0:9354:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 20 17:58:42 EDT 2026 00010000:00010000:2.0:1784584724.767458:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584725.532627:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568985344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584725.532763:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584725.532939:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568985344 00000100:00100000:0.0:1784584725.532958:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568985344 00000100:00100000:0.0:1784584725.533038:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784584725.533049:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568985344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784584725.533093:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584725.533152:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568985344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584725.533161:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1784584725.533218:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b0d180 x1871272568985344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584725.533253:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568985344:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784584725.533361:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784584725.789619:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584726.469188:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584726.469242:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584726.469281:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549032192 00000100:00100000:1.0:1784584726.469293:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549032192 00000100:00100000:3.0:1784584726.469300:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549032064 00000100:00100000:3.0:1784584726.469304:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549032064 00000100:00100000:3.0:1784584726.469361:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:3.0:1784584726.469373:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2354:x1871272549032064:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584726.469467:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2354:x1871272549032064:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584726.469475:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:1.0:1784584726.469594:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1784584726.469602:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549032192:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584726.469652:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549032192:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 51us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584726.469658:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00080000:1.0:1784584726.471740:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784584726.811910:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584727.836002:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584728.604593:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568985472:0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.604715:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584728.604778:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568985984:0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.604809:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584728.604838:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584728.604844:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568985856:0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.604889:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584728.604918:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568985600:0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.604954:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584728.604973:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568986112:0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.604995:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584728.605011:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584728.605015:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272568985728:0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.605035:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584728.605068:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568985984 00000100:00100000:3.0:1784584728.605078:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568985984 00000100:00100000:3.0:1784584728.605138:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568985600 00000100:00100000:3.0:1784584728.605150:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568985600 00000100:00100000:3.0:1784584728.605165:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568985728 00000100:00100000:3.0:1784584728.605167:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568985728 00000100:00100000:3.0:1784584728.605185:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784584728.605194:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568985984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.605257:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568985984:12345-0@lo:400:kworker.0 Request processed in 64us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584728.605265:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784584728.605283:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784584728.605288:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568985600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.605318:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568985600:12345-0@lo:400:kworker.0 Request processed in 29us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584728.605324:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784584728.605334:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784584728.605341:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272568985728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.605367:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272568985728:12345-0@lo:400:kworker.0 Request processed in 26us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584728.605373:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784584728.605414:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272568985728:0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.605426:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568985600:0@lo:400:kworker.0 00000100:00100000:3.0:1784584728.605457:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568985984:0@lo:400:kworker.0 00000100:00100000:2.0:1784584728.605770:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568986240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584728.605806:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584728.605845:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568985856 00000100:00100000:2.0:1784584728.605849:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568985856 00000100:00100000:2.0:1784584728.605894:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568986112 00000100:00100000:2.0:1784584728.605897:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568986112 00000100:00100000:2.0:1784584728.605918:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584728.605925:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568985856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584728.605978:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568985856:12345-0@lo:400:kworker.0 Request processed in 53us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584728.605985:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1784584728.605998:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584728.606004:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568986112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584728.606031:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568986112:12345-0@lo:400:kworker.0 Request processed in 27us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584728.606037:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1784584728.606064:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568986240 00000100:00100000:2.0:1784584728.606067:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568986240 00000100:00100000:2.0:1784584728.606096:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784584728.606114:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568986240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584728.606152:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584728.606192:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568986240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584728.606198:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1784584728.606261:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ff819f80 x1871272568986240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584744 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584728.606279:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568986240:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784584728.606309:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8d500 x1871272568985856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584728.606319:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568985856:0@lo:400:kworker.0 00000100:00080000:1.0:1784584728.606527:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784584728.606533:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784584728.606536:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584728.606747:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568985472 00000100:00100000:0.0:1784584728.606754:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568985472 00000100:00100000:0.0:1784584728.606799:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1784584728.606808:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568985472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584728.606882:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568985472:12345-0@lo:400:kworker.0 Request processed in 75us (2190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584728.606889:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1784584728.609195:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568985472:0@lo:400:kworker.0 00010000:00080000:3.0:1784584728.609347:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8c700 x1871272568986112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584728.609362:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568986112:0@lo:400:kworker.0 00010000:00010000:2.0:1784584728.860124:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584729.887714:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584730.651964:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584730.651988:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568986368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584730.652070:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584730.652131:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568986368 00000100:00100000:3.0:1784584730.652137:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568986368 00000100:00100000:3.0:1784584730.652191:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784584730.652201:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568986368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584730.652234:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584730.652279:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568986368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584730.652286:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1784584730.652305:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784584730.652335:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2abd880 x1871272568986368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584730.652354:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568986368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784584730.908010:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584731.587158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584731.587205:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584731.587264:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549032448 00000100:00100000:3.0:1784584731.587274:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549032448 00000100:00100000:3.0:1784584731.587351:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1784584731.587361:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549032320 00000100:00100000:3.0:1784584731.587362:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549032448:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584731.587368:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549032320 00000100:00100000:2.0:1784584731.587408:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:2.0:1784584731.587417:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2355:x1871272549032320:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584731.587453:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2355:x1871272549032320:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584731.587454:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549032448:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584731.587467:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:3.0:1784584731.587472:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00080000:1.0:1784584731.587677:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784584731.934451:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584732.971115:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584733.726108:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568986880:0@lo:400:kworker.0 00000100:00100000:3.0:1784584733.726197:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568986496:0@lo:400:kworker.0 00000100:00100000:3.0:1784584733.726275:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584733.726330:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584733.726397:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568986752:0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.726427:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584733.726448:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784584733.726455:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568986624:0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.726478:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584733.726497:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568987136:0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.726519:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584733.726555:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568986880 00000100:00100000:1.0:1784584733.726574:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568986880 00000100:00100000:1.0:1784584733.726627:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568987136 00000100:00100000:1.0:1784584733.726631:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568987136 00000100:00100000:1.0:1784584733.726658:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784584733.726667:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568986880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.726988:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568986880:12345-0@lo:400:kworker.0 Request processed in 321us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584733.726995:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784584733.727011:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784584733.727018:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568987136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.727048:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568987136:12345-0@lo:400:kworker.0 Request processed in 32us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584733.727054:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784584733.727069:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568986752 00000100:00100000:1.0:1784584733.727072:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568986752 00000100:00100000:1.0:1784584733.727094:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568986624 00000100:00100000:1.0:1784584733.727096:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568986624 00000100:00100000:1.0:1784584733.727110:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784584733.727187:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568986752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.727218:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568986752:12345-0@lo:400:kworker.0 Request processed in 33us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584733.727223:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784584733.727239:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784584733.727245:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568986624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.727270:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0736d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568986624:12345-0@lo:400:kworker.0 Request processed in 26us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584733.727276:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1784584733.727302:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784584733.727307:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784584733.727309:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784584733.727405:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7d0735180 x1871272568986880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584733.727419:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0735180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568986880:0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.727453:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0737800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568986624:0@lo:400:kworker.0 00010000:00080000:1.0:1784584733.727463:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7d0736680 x1871272568987136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584733.727472:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0736680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568987136:0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.727481:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568986752:0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.731006:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584733.731030:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568987264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584733.731098:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584733.731227:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568987264 00000100:00100000:1.0:1784584733.731241:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568987264 00000100:00100000:1.0:1784584733.731287:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784584733.731296:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568987264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584733.731331:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584733.731384:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568987264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584733.731391:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1784584733.732718:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8ce00 x1871272568987264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584733.732763:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568987264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584733.733660:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568987008:0@lo:400:kworker.0 00000100:00100000:1.0:1784584733.734014:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584733.734144:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568986496 00000100:00100000:2.0:1784584733.734152:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568986496 00000100:00100000:2.0:1784584733.734208:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784584733.734218:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568986496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584733.734239:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568987008 00000100:00100000:0.0:1784584733.734245:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568987008 00000100:00100000:2.0:1784584733.734283:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568986496:12345-0@lo:400:kworker.0 Request processed in 65us (8005us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584733.734303:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1784584733.734354:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0734000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568986496:0@lo:400:kworker.0 00000100:00100000:0.0:1784584733.734415:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784584733.734422:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568987008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584733.734464:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0736680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568987008:12345-0@lo:400:kworker.0 Request processed in 42us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584733.734471:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784584733.734490:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568987008:0@lo:400:kworker.0 00000100:00080000:1.0:1784584733.740241:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784584733.979853:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584735.003878:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584735.771873:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568987392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584735.771962:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584735.772125:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568987392 00000100:00100000:2.0:1784584735.772133:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568987392 00000100:00100000:2.0:1784584735.772208:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784584735.772218:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568987392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584735.772252:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584735.772300:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568987392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584735.772307:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1784584735.772599:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2abd880 x1871272568987392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584735.772618:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2abd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568987392:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784584735.772841:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784584736.030124:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584736.707646:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584736.707735:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584736.707832:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549032576 00000100:00100000:1.0:1784584736.707837:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549032704 00000100:00100000:1.0:1784584736.707845:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549032704 00000100:00100000:2.0:1784584736.707852:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549032576 00000100:00100000:1.0:1784584736.707917:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1784584736.707922:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:1.0:1784584736.707932:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549032704:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584736.707934:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549032576:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584736.708009:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549032704:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584736.708017:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00080000:0.0:1784584736.708143:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584736.712281:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549032576:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4270us (4563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584736.712295:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 202 00010000:00010000:0.0:1784584737.051909:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584738.076686:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784584738.840667:0:9985:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 17:58:56 (1784584736) === 00000100:00100000:3.0:1784584738.844077:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784584738.844103:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568987520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584738.844171:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584738.844299:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568987520 00000100:00100000:0.0:1784584738.844307:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568987520 00000100:00100000:0.0:1784584738.844373:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784584738.844382:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568987520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584738.844425:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584738.844475:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568987520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584738.844481:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1784584738.844519:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8c380 x1871272568987520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784584738.844658:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584738.844786:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568987520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584738.854895:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568987648:0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.854958:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584738.854998:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272568988160:0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855022:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584738.855056:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784584738.855062:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568987776:0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855084:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584738.855111:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568988160 00000100:00100000:0.0:1784584738.855116:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568988160 00000100:00100000:0.0:1784584738.855159:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568987776 00000100:00100000:0.0:1784584738.855161:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568987776 00000100:00100000:0.0:1784584738.855179:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784584738.855186:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272568988160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855229:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272568988160:12345-0@lo:400:kworker.0 Request processed in 43us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584738.855235:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784584738.855249:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784584738.855254:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568987776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855274:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568987776:12345-0@lo:400:kworker.0 Request processed in 20us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584738.855279:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784584738.855311:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568987776:0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855320:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7efeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272568988160:0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855341:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568987904:0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855371:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584738.855397:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584738.855402:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568988032:0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855423:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584738.855444:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568988032 00000100:00100000:0.0:1784584738.855447:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568988032 00000100:00100000:0.0:1784584738.855470:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784584738.855475:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568988032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855502:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568988032:12345-0@lo:400:kworker.0 Request processed in 27us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584738.855507:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784584738.855521:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568987904 00000100:00100000:0.0:1784584738.855524:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568987904 00000100:00100000:0.0:1784584738.855539:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1784584738.855543:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568987904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855567:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568987904:12345-0@lo:400:kworker.0 Request processed in 23us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584738.855572:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1784584738.855597:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2275c00 x1871272568988032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584738.855608:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568988032:0@lo:400:kworker.0 00000100:00100000:0.0:1784584738.855618:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568987904:0@lo:400:kworker.0 00000100:00100000:3.0:1784584738.855762:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568987648 00000100:00100000:3.0:1784584738.855766:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568987648 00000100:00100000:3.0:1784584738.855800:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1784584738.855807:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568987648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584738.855843:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568987648:12345-0@lo:400:kworker.0 Request processed in 37us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584738.855849:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:2.0:1784584738.856103:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584738.856108:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584738.856209:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568987648:0@lo:400:kworker.0 00010000:00010000:0.0:1784584739.100064:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584739.473401:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.473532:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549032832 00000100:00100000:0.0:1784584739.473562:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549032832 00000100:00100000:0.0:1784584739.473614:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:0.0:1784584739.473623:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:8091:x1871272549032832:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784584739.473647:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584739.473912:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf400/0x787d778cc3ff1034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2d6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584739.473947:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf400/0x787d778cc3ff1034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d6e expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584739.473958:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf400/0x787d778cc3ff1034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d6e expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584739.473967:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf400, rc 0) 00000100:00100000:0.0:1784584739.474023:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8091:x1871272549032832:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 401us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.474029:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:1.0:1784584739.476370:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.476459:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549032960 00000100:00100000:0.0:1784584739.476467:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549032960 00000100:00100000:0.0:1784584739.476519:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:0.0:1784584739.476529:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8091:x1871272549032960:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784584739.477063:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8091:x1871272549032960:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 533us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.477071:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:3.0:1784584739.479210:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.479298:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549033088 00000100:00100000:0.0:1784584739.479307:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549033088 00000100:00100000:0.0:1784584739.479361:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:0.0:1784584739.479371:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8091:x1871272549033088:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784584739.479919:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8091:x1871272549033088:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 548us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.479930:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:2.0:1784584739.508100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.508426:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549033216 00000100:00100000:0.0:1784584739.508436:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549033216 00000100:00100000:0.0:1784584739.508483:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:0.0:1784584739.508505:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8095:x1871272549033216:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584739.509402:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8095:x1871272549033216:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 895us (1307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.509412:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:1.0:1784584739.533013:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.534491:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549033344 00000100:00100000:0.0:1784584739.534504:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549033344 00000100:00100000:0.0:1784584739.534574:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:0.0:1784584739.534584:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8095:x1871272549033344:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584739.535293:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8095:x1871272549033344:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 708us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.535303:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:1.0:1784584739.565798:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584739.566041:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549033472 00000100:00100000:3.0:1784584739.566051:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549033472 00000100:00100000:3.0:1784584739.566111:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:3.0:1784584739.566122:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:8091:x1871272549033472:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784584739.566139:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584739.566159:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaec200/0x787d778cc3ff103b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2d98 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584739.566187:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaec200/0x787d778cc3ff103b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d98 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584739.566217:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaec200/0x787d778cc3ff103b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d98 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584739.566226:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec200, rc 0) 00000100:00100000:3.0:1784584739.566284:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:8091:x1871272549033472:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 163us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584739.566291:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:2.0:1784584739.580776:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.580909:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549033600 00000100:00100000:0.0:1784584739.580919:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549033600 00000100:00100000:0.0:1784584739.580976:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:0.0:1784584739.580987:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:8091:x1871272549033600:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784584739.581012:0:5799:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784584739.581035:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784584739.581039:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784584739.581042:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784584739.581049:0:5799:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1784584739.584097:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:8091:x1871272549033600:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 3103us (3320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.584110:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:1.0:1784584739.588198:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.588282:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549033728 00000100:00100000:0.0:1784584739.588292:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549033728 00000100:00100000:0.0:1784584739.588344:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:0.0:1784584739.588354:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:8091:x1871272549033728:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784584739.588369:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584739.588413:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2d9f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584739.588438:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d9f expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584739.588449:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d9f expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584739.588459:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf200, rc 0) 00000100:00100000:0.0:1784584739.588519:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:8091:x1871272549033728:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 166us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.588526:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:2.0:1784584739.597215:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.597331:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549033856 00000100:00100000:0.0:1784584739.597341:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549033856 00000100:00100000:0.0:1784584739.597426:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:0.0:1784584739.597436:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:8091:x1871272549033856:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784584739.597751:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:8091:x1871272549033856:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 314us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.597771:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:2.0:1784584739.603750:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584739.603885:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549033984 00000100:00100000:3.0:1784584739.603895:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549033984 00000100:00100000:3.0:1784584739.603951:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:3.0:1784584739.603962:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:8091:x1871272549033984:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784584739.604176:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:8091:x1871272549033984:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 215us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584739.604185:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:1.0:1784584739.626815:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.627474:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549034112 00000100:00100000:0.0:1784584739.627484:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549034112 00000100:00100000:0.0:1784584739.627535:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:0.0:1784584739.627545:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:8098:x1871272549034112:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584739.627810:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:8098:x1871272549034112:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 264us (1008us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.627818:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:3.0:1784584739.630722:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.630864:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549034240 00000100:00100000:0.0:1784584739.630874:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549034240 00000100:00100000:0.0:1784584739.630926:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:0.0:1784584739.630935:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:8098:x1871272549034240:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584739.631162:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:8098:x1871272549034240:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 226us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.631171:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:2.0:1784584739.640624:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584739.640680:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584739.640910:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549034496 00000100:00100000:1.0:1784584739.640920:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549034496 00000100:00100000:1.0:1784584739.640989:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549034368 00000100:00100000:1.0:1784584739.640992:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549034368 00000100:00100000:1.0:1784584739.641035:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00080000:3.0:1784584739.641040:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584739.641047:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549034496:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584739.641099:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1784584739.641107:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2353:x1871272549034368:12345-192.168.203.52@tcp:38:mount.lustre.0 00000100:00100000:1.0:1784584739.641128:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549034496:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 83us (512us total) trans 0 rc 0/0 00010000:00080000:2.0:1784584739.641134:0:5807:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ec120a06-153f-439e-85c8-b41da9afb57f@192.168.203.52@tcp t0 exp 0000000000000000 cur 234 last 0 00000100:00100000:1.0:1784584739.641140:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000020:00000080:2.0:1784584739.641174:0:5807:0:(genops.c:1406:class_connect()) connect: client ec120a06-153f-439e-85c8-b41da9afb57f, cookie 0x787d778cc3ff1049 00000004:00100000:2.0:1784584739.641206:0:5807:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784584739.642172:0:5807:0:(import.c:65:import_set_state_nolock()) ffff97c7efc08000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584739.642241:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+6:2353:x1871272549034368:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 1132us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584739.642250:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1784584739.649114:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.649207:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549034624 00000100:00100000:0.0:1784584739.649217:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549034624 00000100:00100000:0.0:1784584739.649291:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1784584739.649311:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+6:0:x1871272549034624:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784584739.649364:0:5808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784584739.649461:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+6:0:x1871272549034624:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 161us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.649470:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00080000:3.0:1784584739.649722:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584739.651767:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584739.651929:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549034752 00000100:00100000:2.0:1784584739.651938:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549034752 00000100:00100000:2.0:1784584739.651994:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1784584739.652004:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+6:8091:x1871272549034752:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784584739.652034:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784584739.652106:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+6:8091:x1871272549034752:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 103us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584739.652114:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1784584739.654773:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.654918:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549034880 00000100:00100000:0.0:1784584739.654932:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549034880 00000100:00100000:0.0:1784584739.654992:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1784584739.655002:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+6:8091:x1871272549034880:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784584739.655092:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+6:8091:x1871272549034880:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 90us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.655100:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1784584739.665791:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584739.665834:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584739.665879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584739.666026:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549035264 00000100:00100000:0.0:1784584739.666035:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549035264 00000100:00100000:0.0:1784584739.666093:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1784584739.666104:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec120a06-153f-439e-85c8-b41da9afb57f+6:8091:x1871272549035264:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:0.0:1784584739.666330:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784584739.666485:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ec120a06-153f-439e-85c8-b41da9afb57f+6:8091:x1871272549035264:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 382us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584739.666493:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:3.0:1784584739.666678:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549035008 00000100:00100000:3.0:1784584739.666683:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549035008 00000100:00100000:3.0:1784584739.666736:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549035136 00000100:00100000:3.0:1784584739.666740:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549035136 00000100:00100000:3.0:1784584739.666764:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1784584739.666769:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1871272549035008:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784584739.666793:0:6605:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ec120a06-153f-439e-85c8-b41da9afb57f@192.168.203.52@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1784584739.666822:0:6605:0:(genops.c:1406:class_connect()) connect: client ec120a06-153f-439e-85c8-b41da9afb57f, cookie 0x787d778cc3ff1050 00002000:00100000:3.0:1784584739.666840:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ec120a06-153f-439e-85c8-b41da9afb57f/ffff97c7d8a4c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784584739.666871:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784584739.667036:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784584739.667063:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7d8a49800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584739.667097:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec120a06-153f-439e-85c8-b41da9afb57f+6:2353:x1871272549035008:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 327us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584739.667104:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1784584739.667119:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1784584739.667123:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1871272549035136:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:3.0:1784584739.667137:0:6605:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from ec120a06-153f-439e-85c8-b41da9afb57f@192.168.203.52@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1784584739.667151:0:6605:0:(genops.c:1406:class_connect()) connect: client ec120a06-153f-439e-85c8-b41da9afb57f, cookie 0x787d778cc3ff1057 00002000:00100000:3.0:1784584739.667157:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ec120a06-153f-439e-85c8-b41da9afb57f/ffff97c7d8a4a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784584739.667163:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784584739.667284:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784584739.667298:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7d8a49000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584739.667324:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec120a06-153f-439e-85c8-b41da9afb57f+6:2353:x1871272549035136:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 199us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584739.667330:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00010000:00010000:3.0:1784584740.126144:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784584740.490409:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec120a06-153f-439e-85c8-b41da9afb57f 00000100:00100000:2.0:1784584740.893767:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568988288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584740.893831:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584740.894048:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568988288 00000100:00100000:0.0:1784584740.894056:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568988288 00000100:00100000:0.0:1784584740.894105:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784584740.894113:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568988288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784584740.894144:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584740.894190:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568988288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584740.894196:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1784584740.894216:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784584740.894496:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faae9500 x1871272568988288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584740.894513:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568988288:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1784584740.990289:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec120a06-153f-439e-85c8-b41da9afb57f 00000001:00100000:3.0:1784584741.008107:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec120a06-153f-439e-85c8-b41da9afb57f 00010000:00010000:0.0:1784584741.148279:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584742.173541:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584743.196071:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584743.964097:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568988544:0@lo:400:kworker.0 00000100:00100000:0.0:1784584743.964097:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568988800:0@lo:400:kworker.0 00000100:00100000:1.0:1784584743.964180:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584743.964180:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584743.964233:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568989056:0@lo:400:kworker.0 00000100:00100000:1.0:1784584743.964267:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584743.964270:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568988416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584743.964309:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584743.964321:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568988800 00000100:00100000:1.0:1784584743.964329:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568988800 00000100:00100000:2.0:1784584743.964347:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568988928:0@lo:400:kworker.0 00000100:00100000:1.0:1784584743.964377:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568989056 00000100:00100000:1.0:1784584743.964382:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568989056 00000100:00100000:2.0:1784584743.964386:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584743.964411:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784584743.964420:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568988800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584743.964435:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784584743.964446:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568989056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584743.964469:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272568988800:12345-0@lo:400:kworker.0 Request processed in 50us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584743.964477:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784584743.964495:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0736300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272568989056:12345-0@lo:400:kworker.0 Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584743.964503:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1784584743.964512:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584743.964530:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568988416 00000100:00100000:2.0:1784584743.964535:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568988416 00000100:00080000:1.0:1784584743.964564:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584743.964575:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584743.964583:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568988416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584743.964611:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584743.964654:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568988416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584743.964660:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584743.964722:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272568989056:0@lo:400:kworker.0 00000100:00100000:3.0:1784584743.964846:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568988672:0@lo:400:kworker.0 00000100:00100000:3.0:1784584743.964879:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584743.964947:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568989184:0@lo:400:kworker.0 00000100:00100000:3.0:1784584743.964983:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584743.965015:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568988544 00000100:00100000:3.0:1784584743.965019:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568988544 00000100:00100000:3.0:1784584743.965043:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1784584743.965050:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568988544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584743.965082:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272568988544:12345-0@lo:400:kworker.0 Request processed in 32us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584743.965089:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1784584743.965116:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568988928 00000100:00100000:3.0:1784584743.965119:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568988928 00000100:00100000:3.0:1784584743.965145:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568989184 00000100:00100000:3.0:1784584743.965148:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568989184 00000100:00100000:3.0:1784584743.965164:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784584743.965169:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568988928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584743.965213:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568988928:12345-0@lo:400:kworker.0 Request processed in 43us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584743.965220:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784584743.965231:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784584743.965237:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568989184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584743.965267:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568989184:12345-0@lo:400:kworker.0 Request processed in 30us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584743.965273:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1784584743.965303:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8ea00 x1871272568989184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584743.965316:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568989184:0@lo:400:kworker.0 00000100:00100000:3.0:1784584743.965350:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568988544:0@lo:400:kworker.0 00000100:00080000:1.0:1784584743.965564:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784584743.965588:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8c000 x1871272568988416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584743.965595:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568988672 00000100:00100000:2.0:1784584743.965602:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568988672 00000100:00100000:1.0:1784584743.965615:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568988416:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1784584743.965633:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8e680 x1871272568988928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584743.965641:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568988928:0@lo:400:kworker.0 00000100:00100000:2.0:1784584743.965688:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1784584743.965720:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568988672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584743.965908:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568988672:12345-0@lo:400:kworker.0 Request processed in 189us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584743.965915:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784584743.965999:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568988672:0@lo:400:kworker.0 00000100:00100000:0.0:1784584743.967598:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272568988800:0@lo:400:kworker.0 00010000:00010000:2.0:1784584744.220008:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584744.899754:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584744.899847:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584744.899883:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584744.899904:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584744.899955:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549035776 00000100:00100000:1.0:1784584744.899965:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549035776 00000100:00100000:1.0:1784584744.900019:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:1.0:1784584744.900029:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549035776:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584744.900091:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549035776:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 64us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584744.900098:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00080000:1.0:1784584744.900117:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584744.900231:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549035392 00000100:00100000:1.0:1784584744.900235:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549035392 00000100:00100000:1.0:1784584744.900259:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:1.0:1784584744.900265:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549035392:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584744.900293:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549035392:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584744.900299:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:3.0:1784584744.909951:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584744.909983:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549035904 00000100:00100000:3.0:1784584744.909992:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549035904 00000100:00100000:3.0:1784584744.910048:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1784584744.910059:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549035904:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584744.910124:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549035904:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584744.910132:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00080000:3.0:1784584744.910153:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584744.912045:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549035520 00000100:00100000:2.0:1784584744.912059:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549035520 00000100:00100000:2.0:1784584744.912143:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549035648 00000100:00100000:2.0:1784584744.912146:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549035648 00000100:00100000:2.0:1784584744.912177:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1784584744.912196:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549035520:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584744.912265:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549035520:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 80us (12519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584744.912273:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1784584744.912294:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1784584744.912301:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549035648:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584744.912324:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549035648:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (12419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584744.912331:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00080000:3.0:1784584744.912545:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784584745.243874:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784584745.338279:0:10181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1784584746.011989:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584746.012013:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568989312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584746.012159:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584746.012233:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568989312 00000100:00100000:1.0:1784584746.012240:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568989312 00000100:00100000:1.0:1784584746.012301:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1784584746.012895:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584746.013241:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568989312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784584746.013278:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584746.013878:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568989312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 639us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584746.013888:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1784584746.014966:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8f480 x1871272568989312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584746.014990:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568989312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1784584746.268219:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584747.292345:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584748.319633:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584749.083960:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584749.083986:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568989440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584749.084076:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584749.084560:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568989440 00000100:00100000:1.0:1784584749.084569:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568989440 00000100:00100000:1.0:1784584749.084646:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784584749.084656:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568989440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584749.084688:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584749.084769:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568989440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584749.084776:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1784584749.084978:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784584749.086011:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568989952:0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086060:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584749.086106:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1784584749.086112:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568989568:0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086139:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584749.086160:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272568990080:0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086201:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584749.086229:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568989696:0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086265:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584749.086291:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584749.086296:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272568989824:0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086333:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584749.086361:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568990080 00000100:00100000:1.0:1784584749.086367:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568990080 00000100:00100000:1.0:1784584749.086408:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568989696 00000100:00100000:1.0:1784584749.086411:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568989696 00000100:00100000:1.0:1784584749.086422:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568989824 00000100:00100000:1.0:1784584749.086425:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568989824 00000100:00100000:1.0:1784584749.086440:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784584749.086446:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272568990080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086491:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272568990080:12345-0@lo:400:kworker.0 Request processed in 44us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584749.086497:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784584749.086512:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784584749.086519:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568989696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086549:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568989696:12345-0@lo:400:kworker.0 Request processed in 31us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584749.086555:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784584749.086566:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784584749.086572:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272568989824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086598:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272568989824:12345-0@lo:400:kworker.0 Request processed in 27us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584749.086604:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784584749.086645:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272568989824:0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086655:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaeb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568989696:0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.086727:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272568990080:0@lo:400:kworker.0 00010000:00080000:1.0:1784584749.086777:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7d0737480 x1871272568989440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584765 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584749.087088:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0737480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568989440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584749.087123:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568989568 00000100:00100000:1.0:1784584749.087128:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568989568 00000100:00100000:1.0:1784584749.087156:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784584749.087162:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568989568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584749.087205:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568989568:12345-0@lo:400:kworker.0 Request processed in 44us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584749.087211:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1784584749.087508:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568989568:0@lo:400:kworker.0 00000100:00100000:2.0:1784584749.087824:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568989952 00000100:00100000:2.0:1784584749.087830:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568989952 00000100:00100000:2.0:1784584749.087864:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784584749.087872:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568989952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584749.087928:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568989952:12345-0@lo:400:kworker.0 Request processed in 57us (1867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584749.087947:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1784584749.090809:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faae9f80 x1871272568989952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584749.090827:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568989952:0@lo:400:kworker.0 00000100:00080000:3.0:1784584749.092152:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584749.092160:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784584749.342501:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584750.022970:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584750.023015:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584750.023053:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584750.023085:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584750.023109:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584750.023141:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549036544 00000100:00100000:3.0:1784584750.023162:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549036544 00000100:00100000:3.0:1784584750.023211:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549036416 00000100:00100000:3.0:1784584750.023215:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549036416 00000100:00100000:3.0:1784584750.023235:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1784584750.023245:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549036544:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584750.023324:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549036544:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 68us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584750.023332:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1784584750.023350:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1784584750.023356:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549036416:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584750.023380:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549036416:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584750.023386:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00080000:3.0:1784584750.023402:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584750.023406:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584750.023734:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549036288 00000100:00100000:2.0:1784584750.023740:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549036288 00000100:00100000:2.0:1784584750.023769:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549036160 00000100:00100000:2.0:1784584750.023772:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549036160 00000100:00100000:2.0:1784584750.023800:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1784584750.023807:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549036288:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584750.023842:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549036288:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584750.023848:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1784584750.023860:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1784584750.023866:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549036160:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584750.023886:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549036160:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 20us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584750.023891:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00080000:3.0:1784584750.024078:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584750.024457:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549036032 00000100:00100000:1.0:1784584750.024463:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549036032 00000100:00100000:1.0:1784584750.024502:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:1.0:1784584750.024509:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549036032:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584750.024553:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549036032:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 45us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584750.024560:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 219 00010000:00010000:3.0:1784584750.364044:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584751.131852:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784584751.131888:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568990208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584751.131951:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584751.132012:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568990208 00000100:00100000:1.0:1784584751.132019:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568990208 00000100:00100000:1.0:1784584751.132070:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784584751.132078:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568990208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784584751.132113:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584751.132445:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568990208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 367us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584751.132454:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1784584751.132475:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784584751.132503:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7effb5500 x1871272568990208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584751.132519:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568990208:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784584751.387922:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584752.412473:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584753.435896:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584754.204251:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568990464:0@lo:400:kworker.0 00000100:00100000:1.0:1784584754.204329:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584754.204387:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568990976:0@lo:400:kworker.0 00000100:00100000:1.0:1784584754.204412:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584754.204440:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584754.204447:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568990592:0@lo:400:kworker.0 00000100:00100000:1.0:1784584754.204468:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584754.204517:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568990336:0@lo:400:kworker.0 00000100:00100000:3.0:1784584754.204555:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584754.204581:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568990848:0@lo:400:kworker.0 00000100:00100000:3.0:1784584754.204612:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568990976 00000100:00100000:3.0:1784584754.204618:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568990976 00000100:00100000:3.0:1784584754.204674:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784584754.204684:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568990976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584754.204780:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568990720:0@lo:400:kworker.0 00000100:00100000:0.0:1784584754.205585:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584754.205629:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584754.205642:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568991104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584754.205670:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584754.205736:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568990464 00000100:00100000:1.0:1784584754.205741:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568990464 00000100:00100000:1.0:1784584754.205801:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568990592 00000100:00100000:1.0:1784584754.205804:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568990592 00000100:00100000:1.0:1784584754.205829:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784584754.205836:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568990464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584754.205880:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568990464:12345-0@lo:400:kworker.0 Request processed in 44us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584754.205886:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784584754.205905:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784584754.205911:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568990592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584754.205939:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568990592:12345-0@lo:400:kworker.0 Request processed in 29us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584754.205944:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784584754.205966:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568991104 00000100:00100000:1.0:1784584754.205970:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568991104 00000100:00100000:1.0:1784584754.205992:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584754.205998:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272568991104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584754.206024:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584754.206055:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272568991104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584754.206061:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1784584754.206114:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faaeb800 x1871272568991104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584770 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584754.206133:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568991104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584754.206145:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568990592:0@lo:400:kworker.0 00000100:00100000:1.0:1784584754.206155:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568990464:0@lo:400:kworker.0 00000100:00100000:1.0:1784584754.206207:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568990720 00000100:00100000:1.0:1784584754.206211:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568990720 00000100:00100000:1.0:1784584754.206237:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784584754.206243:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568990720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584754.206291:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568990720:12345-0@lo:400:kworker.0 Request processed in 47us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584754.206297:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584754.208081:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584754.208292:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568990848 00000100:00100000:1.0:1784584754.208301:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568990848 00000100:00100000:1.0:1784584754.208352:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784584754.208362:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568990848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584754.208472:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568990848:12345-0@lo:400:kworker.0 Request processed in 111us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584754.208479:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784584754.208620:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568990848:0@lo:400:kworker.0 00000100:00080000:2.0:1784584754.209606:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584754.209613:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584754.209616:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584754.209631:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568990976:12345-0@lo:400:kworker.0 Request processed in 4944us (5214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584754.209632:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568990336 00000100:00100000:2.0:1784584754.209638:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568990336 00000100:00100000:3.0:1784584754.209653:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784584754.209671:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1784584754.209679:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272568990336:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1784584754.209831:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7effb4a80 x1871272568990976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584754.210096:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568990976:0@lo:400:kworker.0 00000100:00100000:2.0:1784584754.210380:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272568990336:12345-0@lo:400:kworker.0 Request processed in 700us (5822us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584754.210396:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1784584754.210470:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568990336:0@lo:400:kworker.0 00010000:00080000:1.0:1784584754.225592:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7effb4380 x1871272568990720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584770 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584754.225682:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568990720:0@lo:400:kworker.0 00010000:00010000:3.0:1784584754.460029:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584755.141550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584755.141599:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584755.141662:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549036800 00000100:00100000:1.0:1784584755.141686:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549036800 00000100:00100000:1.0:1784584755.141799:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1784584755.141810:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549036800:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584755.141891:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549036800:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 83us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584755.141913:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00080000:0.0:1784584755.142161:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584755.142307:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549037056 00000100:00100000:3.0:1784584755.142312:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549037056 00000100:00100000:3.0:1784584755.142401:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1784584755.142410:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549037056:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584755.142446:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549037056:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584755.142453:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1784584755.142589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584755.142664:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584755.142688:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584755.142744:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549036928 00000100:00100000:0.0:1784584755.142748:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549036928 00000100:00100000:0.0:1784584755.142788:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:0.0:1784584755.142795:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549036928:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584755.142832:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549036928:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584755.142849:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:0.0:1784584755.142871:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549037184 00000100:00100000:0.0:1784584755.142875:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549037184 00000100:00100000:0.0:1784584755.142899:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1784584755.142906:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549037184:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584755.142935:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549037184:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 30us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584755.142942:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1784584755.143191:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549036672 00000100:00100000:3.0:1784584755.143195:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549036672 00000100:00100000:3.0:1784584755.143230:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00080000:1.0:1784584755.143869:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784584755.143874:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784584755.143877:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584755.143976:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549036672:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584755.144029:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549036672:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 58us (1439us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584755.146176:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 221 00010000:00010000:0.0:1784584755.484060:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584756.262725:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584756.263781:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568991232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584756.263851:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584756.264037:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568991232 00000100:00100000:0.0:1784584756.264045:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568991232 00000100:00100000:0.0:1784584756.264102:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584756.264111:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568991232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784584756.264146:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584756.264190:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568991232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584756.264197:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1784584756.264219:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784584756.264401:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8c000 x1871272568991232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584756.264420:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568991232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784584756.509519:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584757.532115:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584758.556860:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584759.323871:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568991360:0@lo:400:kworker.0 00000100:00100000:0.0:1784584759.323942:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584759.323956:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568991744:0@lo:400:kworker.0 00000100:00100000:1.0:1784584759.323989:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584759.323992:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568991872:0@lo:400:kworker.0 00000100:00100000:0.0:1784584759.324016:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584759.324137:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568991744 00000100:00100000:2.0:1784584759.324145:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568991744 00000100:00100000:2.0:1784584759.324210:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584759.324219:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568991744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584759.324268:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568991744:12345-0@lo:400:kworker.0 Request processed in 50us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584759.324275:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584759.324298:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272568991616:0@lo:400:kworker.0 00000100:00100000:2.0:1784584759.324323:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584759.324343:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568992128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584759.324364:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584759.324382:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784584759.324388:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272568991488:0@lo:400:kworker.0 00000100:00100000:2.0:1784584759.324406:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584759.324421:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568992000:0@lo:400:kworker.0 00000100:00100000:2.0:1784584759.324439:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584759.324787:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568991872 00000100:00100000:1.0:1784584759.324792:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568991872 00000100:00100000:1.0:1784584759.324825:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568991616 00000100:00100000:1.0:1784584759.324829:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568991616 00000100:00100000:1.0:1784584759.324844:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568991488 00000100:00100000:1.0:1784584759.324846:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568991488 00000100:00100000:1.0:1784584759.324859:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784584759.324865:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568991872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584759.324977:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568991872:12345-0@lo:400:kworker.0 Request processed in 112us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584759.324984:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784584759.324998:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784584759.325004:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871272568991616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584759.325033:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871272568991616:12345-0@lo:400:kworker.0 Request processed in 29us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584759.325039:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784584759.325113:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784584759.325121:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272568991488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584759.325174:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568991360 00000100:00100000:1.0:1784584759.325214:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272568991488:12345-0@lo:400:kworker.0 Request processed in 93us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584759.325231:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784584759.325260:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568991360 00010000:00080000:1.0:1784584759.325283:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7effb4e00 x1871272568991744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584759.325289:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1784584759.325295:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272568991360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584759.325297:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568991744:0@lo:400:kworker.0 00000100:00100000:0.0:1784584759.325332:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272568991360:12345-0@lo:400:kworker.0 Request processed in 36us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584759.325334:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568992128 00000100:00100000:1.0:1784584759.325338:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568992128 00000100:00100000:0.0:1784584759.325338:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1784584759.325363:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584759.325366:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568992000 00000100:00100000:1.0:1784584759.325368:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568992128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584759.325395:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584759.325427:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568992128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584759.325433:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584759.325441:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568992000 00000100:00080000:1.0:1784584759.325449:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784584759.325453:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784584759.325454:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584759.325464:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784584759.325469:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568992000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584759.325475:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568991872:0@lo:400:kworker.0 00000100:00100000:1.0:1784584759.325483:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568991360:0@lo:400:kworker.0 00000100:00100000:0.0:1784584759.325497:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568992000:12345-0@lo:400:kworker.0 Request processed in 28us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584759.325503:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784584759.325677:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272568991488:0@lo:400:kworker.0 00010000:00080000:2.0:1784584759.325704:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7effb6680 x1871272568992000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584759.325715:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568992000:0@lo:400:kworker.0 00000100:00100000:2.0:1784584759.325726:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272568991616:0@lo:400:kworker.0 00010000:00080000:2.0:1784584759.325744:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faaeb480 x1871272568992128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584775 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584759.325765:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568992128:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1784584759.579907:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784584759.927097:0:10882:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1784584760.263891:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584760.263941:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584760.264028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584760.264057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584760.264131:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584760.264168:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549037568 00000100:00100000:1.0:1784584760.264177:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549037568 00000100:00100000:1.0:1784584760.264248:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549037440 00000100:00100000:1.0:1784584760.264252:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549037440 00000100:00100000:1.0:1784584760.264276:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1784584760.264285:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549037568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584760.264353:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549037568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584760.264361:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1784584760.264376:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1784584760.264383:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549037440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584760.264432:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549037440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 49us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584760.264439:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00080000:1.0:1784584760.264456:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584760.264749:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549037312 00000100:00100000:3.0:1784584760.264754:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549037312 00000100:00100000:3.0:1784584760.264794:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:3.0:1784584760.264812:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549037312:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584760.264859:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549037312:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 50us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584760.264866:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:0.0:1784584760.265111:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549037696 00000100:00100000:0.0:1784584760.265115:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549037696 00000100:00100000:2.0:1784584760.265357:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549037824 00000100:00100000:2.0:1784584760.265362:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549037824 00000100:00100000:0.0:1784584760.265399:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1784584760.265416:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2353:x1871272549037696:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:0.0:1784584760.265440:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff1050 00000100:00080000:0.0:1784584760.265451:0:6608:0:(import.c:65:import_set_state_nolock()) ffff97c7d8a49800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784584760.265491:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1784584760.265836:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ec120a06-153f-439e-85c8-b41da9afb57f+2:2353:x1871272549037696:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 428us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584760.265844:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00080000:1.0:1784584760.266469:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784584760.266474:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784584760.266497:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584760.266875:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1784584760.267124:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2353:x1871272549037824:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:2.0:1784584760.267150:0:6607:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff1057 00000100:00080000:2.0:1784584760.267159:0:6607:0:(import.c:65:import_set_state_nolock()) ffff97c7d8a49000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784584760.267341:0:6607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1784584760.267569:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584760.268585:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3e57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ec120a06-153f-439e-85c8-b41da9afb57f+2:2353:x1871272549037824:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 1693us (4637us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584760.268596:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:1.0:1784584760.603884:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784584760.917855:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ec120a06-153f-439e-85c8-b41da9afb57f 00000020:00000080:3.0:1784584760.917865:0:6631:0:(genops.c:906:class_export_put()) final put ffff97c7d8a4c800/ec120a06-153f-439e-85c8-b41da9afb57f 00000020:00000080:1.0:1784584760.917922:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d8a4c800/ec120a06-153f-439e-85c8-b41da9afb57f for lustre-OST0000 00000020:00000080:1.0:1784584760.917969:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7d8a49800 for lustre-OST0000 00000100:00100000:3.0:1784584761.373661:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568992256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584761.373762:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584761.374378:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568992256 00000100:00100000:1.0:1784584761.374387:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568992256 00000100:00100000:1.0:1784584761.374440:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784584761.374450:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568992256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784584761.374483:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584761.374532:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568992256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584761.374539:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1784584761.374568:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784584761.374788:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faae8e00 x1871272568992256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584761.374806:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568992256:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1784584761.437137:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ec120a06-153f-439e-85c8-b41da9afb57f 00000020:00000080:1.0:1784584761.437148:0:7511:0:(genops.c:906:class_export_put()) final put ffff97c7d8a4a000/ec120a06-153f-439e-85c8-b41da9afb57f 00000020:00000080:1.0:1784584761.437191:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d8a4a000/ec120a06-153f-439e-85c8-b41da9afb57f for lustre-OST0001 00000020:00000080:1.0:1784584761.437231:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7d8a49000 for lustre-OST0001 00010000:00010000:3.0:1784584761.628750:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584762.653207:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784584763.268354:0:11032:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb832e630 20000000:00000080:1.0:1784584763.268371:0:11032:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c7faf89400 uarg=0000000000000000 20000000:01000000:1.0:1784584763.268404:0:11032:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784584763.268410:0:11032:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784584763.268415:0:11032:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784584763.269650:0:11033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1784584763.269918:0:11032:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784584763.281600:0:11032:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784584763.281983:0:11032:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282004:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1003 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282012:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1011 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282018:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff101f expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282029:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d67 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282106:0:11032:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d9f expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282126:0:11032:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282300:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d9f expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282318:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d9f expref: 12 pid: 5800 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584763.282335:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992384:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584763.282877:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d67 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282889:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d67 expref: 12 pid: 5799 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584763.282899:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaeb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992512:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584763.282935:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff101f expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.282943:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff101f expref: 18 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584763.282953:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992640:0@lo:104: 00000100:00100000:2.0:1784584763.282994:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584763.283026:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff1011 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.283060:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff1011 expref: 18 pid: 5799 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584763.283068:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992768:0@lo:104: 00000100:00100000:2.0:1784584763.283090:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584763.283113:0:11032:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff1003 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584763.283120:0:11032:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff1003 expref: 18 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584763.283129:0:11032:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992896:0@lo:104: 00000100:00100000:2.0:1784584763.283162:0:11032:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584763.283175:0:11032:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1917c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584763.283184:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568992640 00000100:00100000:3.0:1784584763.283193:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568992640 00000100:00100000:3.0:1784584763.283233:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568992768 00000100:00100000:3.0:1784584763.283236:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568992768 00000100:00100000:3.0:1784584763.283245:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568992896 00000100:00100000:3.0:1784584763.283248:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568992896 00000100:00100000:3.0:1784584763.283262:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784584763.283270:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+5:11032:x1871272568992640:12345-0@lo:104: 00010000:00010000:3.0:1784584763.283282:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283348:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584763.283354:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+5:11032:x1871272568992640:12345-0@lo:104: Request processed in 85us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584763.283370:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784584763.283388:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784584763.283394:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+4:11032:x1871272568992768:12345-0@lo:104: 00010000:00010000:3.0:1784584763.283403:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584763.283431:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992640:0@lo:104: 00000100:00100000:2.0:1784584763.283443:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992768:0@lo:104: 00010000:00010000:3.0:1784584763.283445:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784584763.283452:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaeb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+4:11032:x1871272568992768:12345-0@lo:104: Request processed in 59us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584763.283460:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784584763.283473:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784584763.283479:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:11032:x1871272568992896:12345-0@lo:104: 00010000:00010000:3.0:1784584763.283487:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283524:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784584763.283529:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c4006421-7015-489e-aaaa-81e9219afdea+3:11032:x1871272568992896:12345-0@lo:104: Request processed in 51us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584763.283535:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1784584763.283556:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1784584763.283561:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992896:0@lo:104: 00010000:00010000:3.0:1784584763.283563:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283573:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fc400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1784584763.283578:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283598:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584763.283606:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584763.283612:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784584763.283650:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283656:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584763.283676:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283683:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff101f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1026 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283725:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584763.283729:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283736:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fd600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1784584763.283740:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283755:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584763.283762:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584763.283775:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784584763.283814:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283820:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584763.283837:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283844:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fd600/0x787d778cc3ff1011 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1018 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283855:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584763.283859:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283866:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fc200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1784584763.283869:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283876:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584763.283882:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584763.283888:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784584763.283910:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283916:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584763.283933:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283940:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc200/0x787d778cc3ff1003 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff100a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.283954:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584763.283956:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584763.283958:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584763.283973:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568993280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584763.285432:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584763.285639:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568993024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584763.286807:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584763.286874:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568993152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584763.286900:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584763.287013:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584763.289499:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568993024 00000100:00100000:3.0:1784584763.289510:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584763.289513:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568993024 00010000:00010000:1.0:1784584763.289555:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff101f expref: 19 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584763.289578:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568993152 00000100:00100000:1.0:1784584763.289582:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568993152 00010000:00010000:1.0:1784584763.289596:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff1011 expref: 20 pid: 5799 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584763.289622:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568993280 00000100:00100000:1.0:1784584763.289626:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568993280 00010000:00010000:1.0:1784584763.289639:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff1003 expref: 21 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584763.290018:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584763.290036:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549037952 00000100:00100000:3.0:1784584763.290040:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549037952 00010000:00010000:3.0:1784584763.290059:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d9f expref: 13 pid: 5800 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584763.290072:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549038080 00000100:00100000:3.0:1784584763.290074:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549038080 00010000:00010000:3.0:1784584763.290082:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d67 expref: 14 pid: 5799 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584763.290094:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584763.290102:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+21:3323:x1871272568993024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584763.290113:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584763.290118:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff101f expref: 21 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290128:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff101f expref: 21 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290150:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff1026 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff101f expref: 21 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290164:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584763.290209:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+20:3323:x1871272568993024:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (3405us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584763.290216:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584763.290231:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784584763.290249:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568993152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584763.290258:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584763.290262:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff1011 expref: 19 pid: 5799 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290269:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff1011 expref: 19 pid: 5799 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290278:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c801818000/0x787d778cc3ff1018 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff1011 expref: 19 pid: 5799 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290285:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584763.290312:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+18:3320:x1871272568993152:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (3411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584763.290317:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784584763.290329:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784584763.290335:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+17:3321:x1871272568993280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584763.290342:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584763.290346:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff1003 expref: 17 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290361:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff1003 expref: 17 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290373:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c801819e00/0x787d778cc3ff100a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff1003 expref: 17 pid: 5800 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290382:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584763.290406:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f63850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+16:3321:x1871272568993280:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (3393us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584763.290412:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784584763.290453:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1784584763.290459:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+14:2354:x1871272549037952:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584763.290467:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584763.290471:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d9f expref: 14 pid: 5800 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.290481:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d9f expref: 14 pid: 5800 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584763.290490:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00010000:00010000:3.0:1784584763.290491:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584763.290503:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+14:2354:x1871272549038080:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584763.290514:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584763.290520:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d67 expref: 14 pid: 5799 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584763.290535:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+14:2354:x1871272549037952:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 71us (1026us total) trans 0 rc 0/0 00010000:00010000:1.0:1784584763.290535:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d67 expref: 14 pid: 5799 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584763.290551:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:1.0:1784584763.290556:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584763.290566:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584763.290580:0:8317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584763.290588:0:8317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584763.290595:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568993024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584763.290596:0:8317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584763.290607:0:8317:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584763.290620:0:8317:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fc800 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584763.290626:0:8317:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584763.290628:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568993152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584763.290642:0:8317:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584763.290942:0:8317:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584763.290955:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584763.290980:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549038080:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 481us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584763.290987:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1784584763.293865:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568993280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584763.293944:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff1042 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d9f expref: 12 pid: 5800 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584763.293978:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992384:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584763.293993:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c801818e00/0x787d778cc3ff102d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d67 expref: 11 pid: 5799 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584763.294002:0:11032:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaeb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11032:1871272568992512:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584763.294033:0:11032:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.294042:0:11032:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.294048:0:11032:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.294053:0:11032:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fc800/0x787d778cc3ff105e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11032 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584763.676113:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584764.355982:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584764.359830:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549038208 00000100:00100000:0.0:1784584764.359846:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549038208 00000100:00100000:0.0:1784584764.359917:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:0.0:1784584764.359927:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:5570:x1871272549038208:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584764.359945:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584764.359974:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2dc9 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.360005:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dc9 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.360016:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dc9 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.360025:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bea00, rc 0) 00000100:00100000:0.0:1784584764.360090:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549038208:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 164us (4117us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584764.360097:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:3.0:1784584764.365873:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584764.366226:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549038336 00000100:00100000:1.0:1784584764.366237:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549038336 00000100:00100000:1.0:1784584764.366293:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:1.0:1784584764.366303:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549038336:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584764.366584:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549038336:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 281us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584764.366592:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:0.0:1784584764.369277:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584764.369355:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549038464 00000100:00100000:1.0:1784584764.369363:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549038464 00000100:00100000:1.0:1784584764.369426:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:1.0:1784584764.369435:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549038464:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584764.369621:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549038464:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 187us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584764.369629:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:2.0:1784584764.374505:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584764.375197:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549038592 00000100:00100000:0.0:1784584764.375208:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549038592 00000100:00100000:0.0:1784584764.375278:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:0.0:1784584764.375288:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549038592:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584764.375304:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584764.375322:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2dd0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.375350:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd0 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.375362:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd0 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.375371:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf800, rc 0) 00000100:00100000:0.0:1784584764.375441:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549038592:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 154us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584764.375448:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:0.0:1784584764.378353:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584764.378410:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549038720 00000100:00100000:2.0:1784584764.378419:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549038720 00000100:00100000:2.0:1784584764.378475:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:2.0:1784584764.378486:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549038720:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584764.378876:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549038720:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 391us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584764.378892:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:3.0:1784584764.381143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584764.381241:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549038848 00000100:00100000:1.0:1784584764.381250:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549038848 00000100:00100000:1.0:1784584764.381303:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:1.0:1784584764.381313:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549038848:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584764.381525:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549038848:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 212us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584764.381533:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:0.0:1784584764.444958:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568993664:0@lo:400:kworker.0 00000100:00100000:0.0:1784584764.445029:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584764.445082:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584764.445089:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568993792:0@lo:400:kworker.0 00000100:00100000:0.0:1784584764.445115:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584764.445169:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568993664 00000100:00100000:0.0:1784584764.445175:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568993664 00000100:00100000:3.0:1784584764.445280:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568993536:0@lo:400:kworker.0 00000100:00100000:3.0:1784584764.445311:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584764.445330:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568994048:0@lo:400:kworker.0 00000100:00100000:3.0:1784584764.445351:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584764.445370:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784584764.445376:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568993408:0@lo:400:kworker.0 00000100:00100000:3.0:1784584764.445422:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584764.445443:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568993920:0@lo:400:kworker.0 00000100:00100000:3.0:1784584764.445465:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584764.445492:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568993536 00000100:00100000:3.0:1784584764.445495:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568993536 00000100:00100000:3.0:1784584764.445588:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568993920 00000100:00100000:3.0:1784584764.445591:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568993920 00000100:00100000:3.0:1784584764.445618:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784584764.445626:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568993536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584764.445675:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272568993536:12345-0@lo:400:kworker.0 Request processed in 49us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584764.445681:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1784584764.445734:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1784584764.445741:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568993920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584764.445768:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568993920:12345-0@lo:400:kworker.0 Request processed in 29us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584764.445775:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1784584764.445796:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584764.445823:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568993920:0@lo:400:kworker.0 00000100:00100000:3.0:1784584764.445834:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272568993536:0@lo:400:kworker.0 00000100:00100000:3.0:1784584764.445858:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568993408 00000100:00100000:3.0:1784584764.445861:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568993408 00000100:00100000:3.0:1784584764.445883:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1784584764.445890:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:3323:x1871272568993408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584764.445913:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568993792 00000100:00100000:2.0:1784584764.445917:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568993792 00000100:00080000:3.0:1784584764.445942:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584764.445942:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568994048 00000100:00100000:2.0:1784584764.445945:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568994048 00000100:00100000:2.0:1784584764.445970:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1784584764.445972:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584764.445978:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568993792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584764.446013:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568993792:12345-0@lo:400:kworker.0 Request processed in 36us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584764.446018:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784584764.446030:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784584764.446036:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568994048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584764.446068:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568994048:12345-0@lo:400:kworker.0 Request processed in 32us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584764.446074:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784584764.446107:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+16:3323:x1871272568993408:12345-0@lo:400:kworker.0 Request processed in 218us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584764.446113:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1784584764.446137:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1784584764.446144:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568993664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584764.446176:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568993664:12345-0@lo:400:kworker.0 Request processed in 33us (1146us total) trans 0 rc 0/0 00000100:00080000:1.0:1784584764.446631:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584764.446849:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784584764.447049:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568994176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584764.447090:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584764.447123:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568994176 00000100:00100000:2.0:1784584764.447128:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568994176 00000100:00100000:0.0:1784584764.447276:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784584764.447291:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584764.447299:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568994176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584764.447330:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584764.447384:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568994176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584764.447391:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1784584764.447427:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faae8000 x1871272568994176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584764.447444:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568994176:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1784584764.447577:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8d500 x1871272568993792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584764.447588:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568993792:0@lo:400:kworker.0 00000100:00100000:2.0:1784584764.447600:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568993664:0@lo:400:kworker.0 00000100:00100000:3.0:1784584764.447824:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568993408:0@lo:400:kworker.0 00010000:00080000:3.0:1784584764.447835:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7ffc8df80 x1871272568994048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584764.447842:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568994048:0@lo:400:kworker.0 00010000:00010000:2.0:1784584764.702674:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1784584764.956803:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784584764.956809:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7fceca000 from 7 10000000:01000000:2.0:1784584764.956813:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584764.956856:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584764.956868:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584764.956878:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584764.956903:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584764.956968:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584764.957013:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1917300 going to sleep for 11 seconds 00000100:00100000:0.0:1784584764.957086:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568994304 00000100:00100000:0.0:1784584764.957094:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568994304 00000100:00100000:0.0:1784584764.957148:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784584764.957158:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568994304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584764.957171:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584764.957183:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff1073 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.957229:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff1073 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.957241:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1073 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.957250:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bee00, rc 0) 00000100:00100000:0.0:1784584764.957293:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568994304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584764.957300:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784584764.957347:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584764.957361:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.957370:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584764.957423:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffc8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584764.957449:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584764.957469:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f3c23240 going to sleep for 11 seconds 00000100:00100000:0.0:1784584764.957480:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568994432 00000100:00100000:0.0:1784584764.957484:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568994432 00000100:00100000:0.0:1784584764.957505:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784584764.957512:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568994432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584764.958064:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568994432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 550us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584764.958082:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1784584764.960580:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffc8e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584764.960639:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584764.960864:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584764.960916:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c19173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584764.961174:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568994560 00000100:00100000:1.0:1784584764.961185:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568994560 00000100:00100000:1.0:1784584764.961271:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1784584764.962781:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568994560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584764.963036:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568994560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1754us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584764.963044:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1784584764.964053:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784584764.966565:0:11085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784584764.966719:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784584764.966745:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784584764.966756:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584764.966769:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584764.966779:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784584764.966782:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7c7f3c000 from 7 10000000:01000000:3.0:1784584764.966785:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784584764.966817:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584764.966826:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584764.966836:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584764.966860:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784584764.966921:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584764.967201:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584764.967669:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568994688 00000100:00100000:0.0:1784584764.967677:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568994688 00000100:00100000:0.0:1784584764.967757:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1784584764.967766:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568994688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584764.967778:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584764.967792:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff1081 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.967813:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff1081 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.967823:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1081 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.967831:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be200, rc 0) 00000100:00100000:0.0:1784584764.967875:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568994688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584764.967881:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1784584764.967891:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584764.967912:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584764.967921:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584764.967974:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584764.968001:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584764.968029:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9af00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584764.968069:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568994816 00000100:00100000:1.0:1784584764.968074:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568994816 00000100:00100000:1.0:1784584764.968107:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1784584764.968116:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568994816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584764.968603:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568994816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 487us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584764.968621:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1784584764.969043:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584764.969087:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584764.969134:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584764.969170:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584764.969337:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568994944 00000100:00100000:0.0:1784584764.969343:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568994944 00000100:00100000:0.0:1784584764.969394:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1784584764.969817:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568994944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584764.970052:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568994944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 649us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584764.970067:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1784584764.971923:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568994944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1784584764.974839:0:11087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784584764.975055:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784584764.975079:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584764.975091:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584764.975104:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584764.975115:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584764.975118:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7d687f000 from 7 10000000:01000000:1.0:1784584764.975120:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584764.975159:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584764.975167:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584764.975178:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584764.975203:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568995072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584764.975344:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584764.975388:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584764.975639:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568995072 00000100:00100000:0.0:1784584764.975646:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568995072 00000100:00100000:0.0:1784584764.975722:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1784584764.975733:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568995072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584764.975746:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584764.975760:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff108f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.975783:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff108f expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.975795:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff108f expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.975803:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be600, rc 0) 00000100:00100000:0.0:1784584764.975856:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568995072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584764.975863:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784584764.976679:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568995072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584764.976751:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584764.976762:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584764.976833:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568995200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584764.976871:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584764.976900:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584764.977008:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568995200 00000100:00100000:0.0:1784584764.977014:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568995200 00000100:00100000:0.0:1784584764.977056:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1784584764.977063:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568995200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584764.977306:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568995200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584764.977314:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784584764.977454:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568995200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584764.977595:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568995328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584764.977653:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584764.977680:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1917840 going to sleep for 11 seconds 00000100:00100000:1.0:1784584764.978092:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568995328 00000100:00100000:1.0:1784584764.978098:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568995328 00000100:00100000:1.0:1784584764.978126:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1784584764.978133:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568995328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584764.978307:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568995328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584764.978314:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1784584764.978360:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568995328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784584764.985733:0:11089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1784584764.986071:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1784584764.986098:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784584764.986111:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584764.986123:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584765.387995:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584765.388033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584765.388056:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584765.388094:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549038976 00000100:00100000:3.0:1784584765.388103:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549038976 00000100:00100000:3.0:1784584765.388157:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:3.0:1784584765.388168:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549038976:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584765.388727:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549038976:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 523us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584765.388737:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:3.0:1784584765.388784:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549039232 00000100:00100000:3.0:1784584765.388788:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549039232 00000100:00100000:3.0:1784584765.388826:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549039104 00000100:00100000:3.0:1784584765.388830:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549039104 00000100:00100000:3.0:1784584765.388853:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:3.0:1784584765.388860:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549039232:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584765.388897:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549039232:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584765.388904:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:3.0:1784584765.388917:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:3.0:1784584765.388923:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549039104:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584765.388949:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549039104:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584765.388955:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00080000:3.0:1784584765.389075:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784584765.724830:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584766.499199:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568995456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584766.499274:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584766.499355:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568995456 00000100:00100000:1.0:1784584766.499362:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568995456 00000100:00100000:1.0:1784584766.499414:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784584766.499422:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568995456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784584766.499474:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584766.499526:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568995456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584766.499533:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1784584766.499555:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784584766.499604:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7effb4380 x1871272568995456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584766.499623:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568995456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784584766.748266:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784584767.049300:0:11229:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784584767.771960:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584768.796024:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584769.564125:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568995584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584769.564174:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568995712:0@lo:400:kworker.0 00000100:00100000:0.0:1784584769.564226:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584769.564238:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584769.564285:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568995584 00000100:00100000:2.0:1784584769.564294:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568995584 00000100:00100000:2.0:1784584769.564364:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784584769.564374:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568995584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584769.564548:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584769.566754:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568995840:0@lo:400:kworker.0 00000100:00100000:3.0:1784584769.567447:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568996224:0@lo:400:kworker.0 00000100:00100000:3.0:1784584769.567504:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584769.567529:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584769.567537:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568996096:0@lo:400:kworker.0 00000100:00100000:3.0:1784584769.567566:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584769.567609:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568996224 00000100:00100000:3.0:1784584769.567617:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568996224 00000100:00100000:1.0:1784584769.567623:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584769.567638:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272568995584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3261us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584769.567653:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784584769.567710:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568995840 00000100:00100000:3.0:1784584769.567714:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568995840 00000100:00080000:2.0:1784584769.567720:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584769.567728:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584769.567744:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784584769.567755:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568996224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584769.567764:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584769.567775:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568995968:0@lo:400:kworker.0 00000100:00100000:2.0:1784584769.567801:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784584769.567813:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568995840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584769.567819:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584769.567825:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272568996224:12345-0@lo:400:kworker.0 Request processed in 70us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584769.567833:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1784584769.567849:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568995968 00000100:00100000:3.0:1784584769.567854:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568995968 00000100:00100000:3.0:1784584769.567878:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1784584769.567883:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568995968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584769.567913:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568995968:12345-0@lo:400:kworker.0 Request processed in 29us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584769.567919:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1784584769.567949:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584769.567955:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568995968:0@lo:400:kworker.0 00010000:00080000:0.0:1784584769.567963:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faae8a80 x1871272568995584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584785 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584769.567974:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272568996224:0@lo:400:kworker.0 00000100:00100000:0.0:1784584769.567986:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272568995584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584769.568001:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568995712 00000100:00100000:1.0:1784584769.568007:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568995712 00000100:00100000:3.0:1784584769.568017:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568996096 00000100:00100000:3.0:1784584769.568023:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568996096 00000100:00100000:1.0:1784584769.568050:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1784584769.568060:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272568995712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584769.568068:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784584769.568086:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568996096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584769.568103:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272568995712:12345-0@lo:400:kworker.0 Request processed in 45us (3863us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584769.568111:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00080000:0.0:1784584769.568134:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7effb5500 x1871272568996096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584769.568144:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568996096:0@lo:400:kworker.0 00000100:00100000:0.0:1784584769.568156:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568995712:0@lo:400:kworker.0 00000100:00100000:3.0:1784584769.570026:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568996096:12345-0@lo:400:kworker.0 Request processed in 1930us (2445us total) trans 0 rc 0/0 00000100:00080000:0.0:1784584769.570036:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584769.570044:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1784584769.570937:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272568995840:12345-0@lo:400:kworker.0 Request processed in 3123us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584769.570949:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784584769.571065:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272568995840:0@lo:400:kworker.0 00010000:00010000:3.0:1784584769.820929:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784584770.348475:0:11329:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 17:59:28 (1784584768) === 00000100:00100000:3.0:1784584770.504319:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584770.504361:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584770.504400:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584770.504405:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549039360 00000100:00100000:0.0:1784584770.504415:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549039360 00000100:00100000:0.0:1784584770.504472:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00100000:0.0:1784584770.504484:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549039360:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584770.504564:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549039360:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 81us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584770.504817:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 242 00000100:00100000:3.0:1784584770.505670:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584770.510896:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584770.512554:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549039616 00000100:00100000:2.0:1784584770.512567:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549039616 00000100:00100000:2.0:1784584770.512654:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549039488 00000100:00080000:3.0:1784584770.512666:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584770.512669:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549039488 00000100:00080000:3.0:1784584770.512707:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584770.512720:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549039744 00000100:00100000:2.0:1784584770.512738:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549039744 00000100:00100000:2.0:1784584770.512762:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:2.0:1784584770.512772:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549039616:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584770.512855:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549039616:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 84us (8492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584770.512863:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:2.0:1784584770.512881:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1784584770.512887:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549039488:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584770.512912:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549039488:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 25us (8513us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584770.512918:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1784584770.512931:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1784584770.512937:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549039744:12345-192.168.203.52@tcp:41:mkdir.0 00000004:00000024:2.0:1784584770.512965:0:6997:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784584770.513012:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549039744:12345-192.168.203.52@tcp:41:mkdir.0 Request processed in 73us (7353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584770.513019:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549039872 00000100:00100000:2.0:1784584770.513020:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1784584770.513026:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549039872 00000100:00100000:0.0:1784584770.513465:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1784584770.513473:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:9642:x1871272549039872:12345-192.168.203.52@tcp:700:mkdir.0 00000100:00100000:0.0:1784584770.513513:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:9642:x1871272549039872:12345-192.168.203.52@tcp:700:mkdir.0 Request processed in 42us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584770.513520:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1784584770.521558:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584770.521991:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549040128 00000100:00100000:0.0:1784584770.522001:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549040128 00000100:00100000:0.0:1784584770.522060:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1784584770.522070:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:9642:x1871272549040128:12345-192.168.203.52@tcp:36:mkdir.0 00010000:00010000:0.0:1784584770.522133:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584770.522196:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c166fe00/0x787d778cc3ff0f7e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d52 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584770.522214:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:0.0:1784584770.522224:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584770.522558:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.522572:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.522583:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.522622:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.522631:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.522638:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584770.523950:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784584770.523964:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.523981:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.523988:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.523995:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584770.523999:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.524006:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.524019:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88100) 00010000:00010000:1.0:1784584770.524022:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584770.524026:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.524032:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff109d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584770.524049:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e276bf6d reply state 00000000c9c394f2 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584770.524058:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584770.524152:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:9642:x1871272549040128:12345-192.168.203.52@tcp:36:mkdir.0 Request processed in 2081us (2601us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784584770.524161:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:1.0:1784584770.530384:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.530416:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.530423:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.530430:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584770.530434:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.530440:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.530456:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97c7d6b88700) 00010000:00010000:1.0:1784584770.530458:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584770.530462:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.530468:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819400/0x787d778cc3ff10a4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584770.539555:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584770.540365:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549040256 00000100:00100000:2.0:1784584770.540377:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549040256 00000100:00100000:2.0:1784584770.540437:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1784584770.540447:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:9644:x1871272549040256:12345-192.168.203.52@tcp:101:chmod.0 00010000:00010000:2.0:1784584770.540467:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584770.540492:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2dd7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.540578:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10b2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.540592:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.540604:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584770.540674:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784584770.540678:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584770.540754:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10b2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.540782:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd7 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.540799:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10b2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd7 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.540807:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584770.540810:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784584770.540814:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fc200, rc 0) 00000100:00100000:2.0:1784584770.540971:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:9644:x1871272549040256:12345-192.168.203.52@tcp:101:chmod.0 Request processed in 525us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584770.540978:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1784584770.546148:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584770.546752:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549040512 00000100:00100000:2.0:1784584770.546762:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549040512 00000100:00100000:2.0:1784584770.546941:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:2.0:1784584770.546951:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:9644:x1871272549040512:12345-192.168.203.52@tcp:36:chmod.0 00010000:00010000:2.0:1784584770.547007:0:6997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584770.547032:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10b2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd7 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.547049:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584770.547059:0:6997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584770.547086:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.547136:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.547145:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584770.547586:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc5ed231 reply state 000000003edba797 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584770.547597:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784584770.547608:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1784584770.547972:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:9644:x1871272549040512:12345-192.168.203.52@tcp:36:chmod.0 Request processed in 1020us (1830us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1784584770.547980:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00010000:00010000:2.0:1784584770.551752:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.551768:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.551786:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.551793:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fd600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584770.551798:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.551807:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.551822:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7c58a0800) 00010000:00010000:2.0:1784584770.551825:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784584770.551830:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.551836:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10b9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584770.574405:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584770.574819:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549040640 00000100:00100000:1.0:1784584770.574834:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549040640 00000100:00100000:1.0:1784584770.574906:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1784584770.574916:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:9646:x1871272549040640:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:1.0:1784584770.574940:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584770.574961:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff10c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2dde expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.575043:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff10c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.575056:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff10c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.575066:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff10c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584770.575120:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784584770.575124:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584770.575160:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff10c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.575185:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff10c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dde expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.575205:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff10c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dde expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.575214:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88700) 00010000:00010000:1.0:1784584770.575217:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584770.575220:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818600, rc 0) 00000100:00100000:1.0:1784584770.575286:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:9646:x1871272549040640:12345-192.168.203.52@tcp:101:chown.0 Request processed in 371us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584770.575293:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1784584770.581325:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584770.581645:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549040768 00000100:00100000:1.0:1784584770.581665:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549040768 00000100:00100000:1.0:1784584770.582546:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1784584770.582560:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:9646:x1871272549040768:12345-192.168.203.52@tcp:101:chown.0 00010000:00010000:1.0:1784584770.582582:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584770.582603:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff10ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2de5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.582688:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.582723:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.582735:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.582750:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.582759:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.582765:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583440:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff10e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583451:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff10e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583571:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff10e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584770.583634:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:1.0:1784584770.583638:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584770.583674:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff10e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583688:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583806:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583813:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583820:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584770.583826:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583910:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583925:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88700) 00010000:00010000:1.0:1784584770.583928:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584770.583932:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583937:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff10d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583951:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583968:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583973:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.583978:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584770.584047:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.584113:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.584122:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97c7d6b88100) 00010000:00010000:1.0:1784584770.584124:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584770.584127:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.584133:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff10dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.584174:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819800/0x787d778cc3ff10ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2de5 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.584189:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff10e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2de5 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.584195:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7d6b88d00) 00010000:00010000:1.0:1784584770.584197:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584770.584205:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818800, rc 0) 00000100:00100000:1.0:1784584770.584427:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:9646:x1871272549040768:12345-192.168.203.52@tcp:101:chown.0 Request processed in 1870us (3110us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584770.584437:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:3.0:1784584770.594311:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584770.594418:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549041024 00000100:00100000:1.0:1784584770.594440:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549041024 00000100:00100000:1.0:1784584770.594517:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1784584770.594529:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:9646:x1871272549041024:12345-192.168.203.52@tcp:36:chown.0 00010000:00010000:1.0:1784584770.594593:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584770.594621:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff10e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2de5 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.594640:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7d6b88d00) 00010000:00010000:1.0:1784584770.594651:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584770.594726:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.594739:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.594750:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584770.667536:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1784584770.667963:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c9f39811 reply state 00000000160d340f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584770.667976:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1784584770.668134:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1784584770.668244:0:5807:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1784584770.668274:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:9646:x1871272549041024:12345-192.168.203.52@tcp:36:chown.0 Request processed in 73742us (73971us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1784584770.668291:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00010000:00010000:2.0:1784584770.668465:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.668476:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.668483:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.668489:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584770.668493:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.668509:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.668524:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7d6b88400) 00010000:00010000:2.0:1784584770.668526:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784584770.668530:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.668536:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818e00/0x787d778cc3ff10ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584770.705900:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584770.706059:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549041152 00000100:00100000:2.0:1784584770.706067:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549041152 00000100:00100000:2.0:1784584770.706196:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1784584770.706207:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:9647:x1871272549041152:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:2.0:1784584770.706230:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584770.706250:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2dec expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784584770.710075:0:6997:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3775us 00010000:00010000:2.0:1784584770.725031:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.725055:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.725065:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.726373:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.726386:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.726394:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728372:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fde00/0x787d778cc3ff1106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728391:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fde00/0x787d778cc3ff1106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728402:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fde00/0x787d778cc3ff1106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584770.728489:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784584770.728493:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584770.728619:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fde00/0x787d778cc3ff1106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728634:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728641:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728649:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728675:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fc200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584770.728680:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728688:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728723:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88700) 00010000:00010000:2.0:1784584770.728726:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584770.728731:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728738:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc200/0x787d778cc3ff10f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728752:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728758:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728763:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728768:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fc800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584770.728770:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728776:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728795:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97c7c58a0800) 00010000:00010000:2.0:1784584770.728797:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584770.728801:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728806:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fc800/0x787d778cc3ff10ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728844:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fd600/0x787d778cc3ff10f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dec expref: 8 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728860:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fde00/0x787d778cc3ff1106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dec expref: 7 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.728868:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584770.728871:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784584770.728873:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c13fde00, rc 0) 00000100:00100000:2.0:1784584770.728942:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:9647:x1871272549041152:12345-192.168.203.52@tcp:101:touch.500 Request processed in 22737us (23060us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584770.728952:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1784584770.733142:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584770.733769:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549041408 00000100:00100000:2.0:1784584770.733778:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549041408 00000100:00100000:2.0:1784584770.733885:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:2.0:1784584770.733896:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:9647:x1871272549041408:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:2.0:1784584770.733917:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584770.733938:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff110d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2df3 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.735393:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.735413:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.735424:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.735477:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.735485:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.735493:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784584770.738941:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1784584770.739955:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.739974:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.739985:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.740022:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.740042:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.740050:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.740056:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584770.740060:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.740068:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.740222:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584770.740226:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584770.740231:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.740238:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1114 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584770.740252:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000798475e7 reply state 000000007ba6a4bd transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584770.740261:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784584770.740300:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff110d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2df3 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.740315:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2df3 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.740334:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c7c58a0f00) 00010000:00010000:2.0:1784584770.740337:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584770.740339:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2c00, rc 0) 00000100:00100000:2.0:1784584770.740458:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:9647:x1871272549041408:12345-192.168.203.52@tcp:101:touch.500 Request processed in 6563us (7324us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784584770.740467:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00010000:00010000:3.0:1784584770.743549:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.743568:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.743576:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.743581:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584770.743798:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.743826:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.743846:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x67f9da71 (ffff97c7c58a0b00) 00010000:00010000:3.0:1784584770.743849:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584770.743854:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.743860:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff111b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584770.750548:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584770.750721:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549041664 00000100:00100000:1.0:1784584770.750731:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549041664 00000100:00100000:1.0:1784584770.750786:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1784584770.750796:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:9647:x1871272549041664:12345-192.168.203.52@tcp:36:touch.500 00010000:00010000:1.0:1784584770.750855:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584770.750882:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2df3 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.750900:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c7c58a0f00) 00010000:00010000:1.0:1784584770.750910:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584770.750953:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.750967:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.750977:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584770.751121:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d06c0717 reply state 00000000968e4a9f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584770.751132:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584770.751230:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:9647:x1871272549041664:12345-192.168.203.52@tcp:36:touch.500 Request processed in 434us (689us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784584770.751237:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00010000:00010000:1.0:1784584770.755216:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.755242:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.755249:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.755256:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584770.755261:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.755269:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.755286:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c7d6b88d00) 00010000:00010000:1.0:1784584770.755289:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584770.755294:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.755300:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1130 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584770.757294:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584770.757377:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549041792 00000100:00100000:3.0:1784584770.757386:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549041792 00000100:00100000:3.0:1784584770.757474:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1784584770.757484:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:9647:x1871272549041792:12345-192.168.203.52@tcp:101:touch.500 00010000:00010000:3.0:1784584770.757508:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584770.757665:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1137 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2dfa expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.757852:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1137 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dfa expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.758064:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1137 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dfa expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.758096:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584770.758100:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584770.758122:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaeca00, rc 0) 00000100:00100000:3.0:1784584770.758412:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:9647:x1871272549041792:12345-192.168.203.52@tcp:101:touch.500 Request processed in 929us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584770.758421:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1784584770.761451:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584770.761540:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549041920 00000100:00100000:0.0:1784584770.761549:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549041920 00000100:00100000:0.0:1784584770.761735:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:0.0:1784584770.761743:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2353:x1871272549041920:12345-192.168.203.52@tcp:8:touch.500 00010000:00080000:0.0:1784584770.761776:0:6607:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1784584770.761818:0:6607:0:(genops.c:1406:class_connect()) connect: client 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2, cookie 0x787d778cc3ff113e 00002000:00100000:0.0:1784584770.761829:0:6607:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2/ffff97c801aef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784584770.761852:0:6607:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784584770.762073:0:6607:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784584770.762122:0:6607:0:(import.c:65:import_set_state_nolock()) ffff97c801ae9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584770.762198:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2353:x1871272549041920:12345-192.168.203.52@tcp:8:touch.500 Request processed in 454us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584770.762207:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1784584770.765305:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584770.765422:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549042048 00000100:00100000:0.0:1784584770.765432:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549042048 00000100:00100000:0.0:1784584770.765507:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:0.0:1784584770.765516:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:0:x1871272549042048:12345-192.168.203.52@tcp:2:touch.500 00000100:00080000:3.0:1784584770.765737:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584770.809612:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:0:x1871272549042048:12345-192.168.203.52@tcp:2:touch.500 Request processed in 44087us (44307us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784584770.809625:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000001:00080000:3.0:1784584770.810337:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1784584770.810350:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000100:00100000:3.0:1784584770.821683:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584770.822535:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549042304 00000100:00100000:1.0:1784584770.822546:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549042304 00000100:00100000:1.0:1784584770.822646:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1784584770.822667:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:9647:x1871272549042304:12345-192.168.203.52@tcp:35:touch.500 00000100:00100000:1.0:1784584770.823045:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+11:9647:x1871272549042304:12345-192.168.203.52@tcp:35:touch.500 Request processed in 389us (1372us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1784584770.823054:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00010000:00010000:3.0:1784584770.845674:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584770.845985:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584770.846111:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549042432 00000100:00100000:1.0:1784584770.846121:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549042432 00000100:00100000:1.0:1784584770.846191:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1784584770.846202:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+11:9648:x1871272549042432:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:1.0:1784584770.846226:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584770.846255:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1145 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e01 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.846314:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff114c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.846328:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff114c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.846339:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff114c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584770.846397:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784584770.846400:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584770.846435:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff114c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.846469:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1145 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e01 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.846484:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff114c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e01 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.846492:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:1.0:1784584770.846495:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584770.846511:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819200, rc 0) 00000100:00100000:1.0:1784584770.846569:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+12:9648:x1871272549042432:12345-192.168.203.52@tcp:101:rm.0 Request processed in 369us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584770.846576:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1784584770.861864:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584770.869240:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549042688 00000100:00100000:2.0:1784584770.869255:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549042688 00000100:00100000:2.0:1784584770.869394:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1784584770.869405:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+12:9648:x1871272549042688:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:2.0:1784584770.869426:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584770.869449:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e08 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584770.869575:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784584770.869773:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1153 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e08 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.869787:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88700) 00010000:00010000:2.0:1784584770.869790:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584770.869795:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e08 expref: 14 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.869816:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2600, rc 0) 00000100:00100000:2.0:1784584770.869876:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:9648:x1871272549042688:12345-192.168.203.52@tcp:101:rm.0 Request processed in 473us (8022us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1784584770.869884:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1784584770.879624:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584770.879771:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549042816 00000100:00100000:0.0:1784584770.879781:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549042816 00000100:00100000:0.0:1784584770.879834:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:0.0:1784584770.879844:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:9648:x1871272549042816:12345-192.168.203.52@tcp:37:rm.0 00000100:00100000:3.0:1784584770.888978:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:9648:x1871272549042816:12345-192.168.203.52@tcp:37:rm.0 Request processed in 9115us (9344us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584770.888991:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1784584770.898762:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584770.899064:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549043072 00000100:00100000:1.0:1784584770.899075:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549043072 00000100:00100000:1.0:1784584770.899140:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1784584770.899150:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f44050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:9648:x1871272549043072:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:1.0:1784584770.899419:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f44050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:9648:x1871272549043072:12345-192.168.203.52@tcp:35:rm.0 Request processed in 269us (665us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784584770.899428:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1784584770.903796:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584770.903883:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549043328 00000100:00100000:2.0:1784584770.903893:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549043328 00000100:00100000:2.0:1784584770.903948:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1784584770.903959:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:9648:x1871272549043328:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:2.0:1784584770.903984:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584770.904003:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e0f expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.904116:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff1168 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.904130:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff1168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.904142:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff1168 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584770.904163:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1784584770.904277:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e0f expref: 17 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.904296:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff1168 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e0f expref: 16 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.904318:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584770.904321:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784584770.904324:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3a00, rc 0) 00000100:00100000:2.0:1784584770.904396:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:9648:x1871272549043328:12345-192.168.203.52@tcp:101:rm.0 Request processed in 439us (609us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784584770.904404:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1784584770.918927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584770.920687:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549043456 00000100:00100000:3.0:1784584770.920916:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549043456 00000100:00100000:3.0:1784584770.920982:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1784584770.920993:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:9648:x1871272549043456:12345-192.168.203.52@tcp:41:rm.0 00000004:00000024:3.0:1784584770.921054:0:5807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1784584770.922091:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:9648:x1871272549043456:12345-192.168.203.52@tcp:41:rm.0 Request processed in 1095us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584770.922113:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1784584770.931271:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584770.932029:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549043584 00000100:00100000:3.0:1784584770.932040:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549043584 00000100:00100000:3.0:1784584770.932114:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1784584770.932123:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:9648:x1871272549043584:12345-192.168.203.52@tcp:101:rm.0 00010000:00010000:3.0:1784584770.932303:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584770.932322:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e16 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932483:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932498:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932508:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932522:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932528:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932535:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932681:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff118b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932851:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff118b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932860:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff118b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584770.932887:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784584770.932895:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584770.932913:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff118b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932924:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff118b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932932:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932939:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932946:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932952:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaede00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584770.932956:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932963:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932974:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:3.0:1784584770.932977:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584770.932981:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932987:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff117d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.932998:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.933013:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.933019:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.933024:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584770.933027:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.933033:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.933041:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x67f9da71 (ffff97c7e189c800) 00010000:00010000:3.0:1784584770.933043:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584770.933046:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.933052:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.933083:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e16 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.933247:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff118b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e16 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.933258:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584770.933261:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784584770.933268:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaece00, rc 0) 00000100:00100000:3.0:1784584770.933319:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:9648:x1871272549043584:12345-192.168.203.52@tcp:101:rm.0 Request processed in 1197us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584770.933327:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:0.0:1784584770.940026:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584770.940143:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549043840 00000100:00100000:2.0:1784584770.940152:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549043840 00000100:00100000:2.0:1784584770.940211:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1784584770.940220:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:9648:x1871272549043840:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:2.0:1784584770.940389:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784584770.940420:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff118b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e16 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940445:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1137 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dfa expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940456:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:2.0:1784584770.940471:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff114c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e01 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940479:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584770.940482:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584770.940506:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940541:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940560:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940576:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940584:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940590:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940902:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940911:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.940918:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584770.942155:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1784584770.942167:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 266049474462ns, next at 267049472209ns, rc = 0 00010000:00010000:2.0:1784584770.942937:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.942952:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.942978:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.942986:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.942994:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943000:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943082:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584770.943104:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943111:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943117:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943123:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584770.943128:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943134:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943145:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:2.0:1784584770.943148:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784584770.943159:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943165:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff11a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943184:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943191:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943196:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943202:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584770.943205:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943210:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943218:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584770.943220:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584770.943289:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.943299:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1192 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584770.943309:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e367ca15 reply state 00000000946e0266 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584770.943328:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784584770.943422:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:9648:x1871272549043840:12345-192.168.203.52@tcp:36:rm.0 Request processed in 3199us (3401us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784584770.943430:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00010000:00010000:3.0:1784584770.946838:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584770.946852:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.946862:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3600 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584770.946866:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.946874:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.946892:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:3.0:1784584770.946895:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784584770.946899:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.946905:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff11a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.947209:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.947217:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.947232:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.947254:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584770.947258:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.947264:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.947272:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x67f9da71 (ffff97c7c58a0800) 00010000:00010000:3.0:1784584770.947275:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584770.947278:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.947283:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1199 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x67f9da71 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584770.948769:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584770.948774:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584770.948776:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584770.951082:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584770.951272:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549044096 00000100:00100000:1.0:1784584770.951281:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549044096 00000100:00100000:1.0:1784584770.951330:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1784584770.951340:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:9648:x1871272549044096:12345-192.168.203.52@tcp:35:rm.0 00000100:00100000:1.0:1784584770.952635:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:9648:x1871272549044096:12345-192.168.203.52@tcp:35:rm.0 Request processed in 1290us (1554us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784584770.952647:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:0.0:1784584770.958436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584770.958544:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549044352 00000100:00100000:3.0:1784584770.958552:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549044352 00000100:00100000:3.0:1784584770.958609:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1784584770.958618:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:9648:x1871272549044352:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:3.0:1784584770.958681:0:6997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784584770.958735:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff1168 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e0f expref: 16 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.958754:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c13fde00/0x787d778cc3ff1106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dec expref: 15 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.958765:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:3.0:1784584770.958777:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff10c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dde expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.958801:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88700) 00010000:00010000:3.0:1784584770.958808:0:6997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584770.958831:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.958843:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.958852:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.958874:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.958881:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.958888:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.959505:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.959516:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.959524:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584770.961495:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1784584770.961517:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961540:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961547:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961554:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaede00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584770.961558:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961566:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961581:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff97c7e189c700) 00010000:00010000:3.0:1784584770.961584:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784584770.961588:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961594:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff11bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961619:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961625:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961631:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961635:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584770.961645:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961650:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961670:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c800) 00010000:00010000:3.0:1784584770.961673:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584770.961676:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584770.961681:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff11ae lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584770.961765:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f662784b reply state 00000000d7c1457c transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584770.961775:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784584770.961909:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:9648:x1871272549044352:12345-192.168.203.52@tcp:36:rm.0 Request processed in 3289us (3478us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1784584770.961918:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00010000:00010000:1.0:1784584770.966735:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.966755:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.966762:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.966789:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584770.966794:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.966802:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.966819:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff97c7e189cb00) 00010000:00010000:1.0:1784584770.966822:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584770.966826:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584770.966832:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff11b5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584771.621113:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584771.621136:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568996352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584771.621210:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584771.621313:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568996352 00000100:00100000:2.0:1784584771.621321:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568996352 00000100:00100000:2.0:1784584771.621382:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784584771.621392:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568996352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584771.621413:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584771.621458:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568996352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584771.621466:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1784584771.621507:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faaea300 x1871272568996352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584771.621524:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568996352:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784584771.624279:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784584771.868004:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584772.892345:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584773.916820:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784584774.237297:0:11479:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1784584774.684438:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584774.684462:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568996480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584774.684529:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584774.684564:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568996480 00000100:00100000:2.0:1784584774.684572:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568996480 00000100:00080000:0.0:1784584774.684617:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584774.684648:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784584774.684658:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568996480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584774.684715:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584774.684765:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272568996480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584774.684786:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784584774.684796:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568996608:0@lo:400:kworker.0 00000100:00100000:2.0:1784584774.684813:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568996864:0@lo:400:kworker.0 00000100:00100000:0.0:1784584774.684844:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584774.684847:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584774.684874:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568996992:0@lo:400:kworker.0 00000100:00100000:0.0:1784584774.684875:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272568997120:0@lo:400:kworker.0 00010000:00080000:2.0:1784584774.684885:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faaea300 x1871272568996480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584774.684903:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272568996480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584774.684908:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584774.684928:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584774.684929:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584774.684930:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568996864 00000100:00100000:2.0:1784584774.684933:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568996864 00000100:00100000:0.0:1784584774.684936:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568996736:0@lo:400:kworker.0 00000100:00100000:0.0:1784584774.684964:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584774.684973:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568996992 00000100:00100000:1.0:1784584774.685000:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568996608 00000100:00100000:1.0:1784584774.685005:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568996608 00000100:00100000:2.0:1784584774.685017:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568997120 00000100:00100000:2.0:1784584774.685021:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568997120 00000100:00100000:2.0:1784584774.685045:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568996736 00000100:00100000:1.0:1784584774.685045:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1784584774.685050:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568996736 00000100:00100000:1.0:1784584774.685057:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568996608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584774.685069:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784584774.685087:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568996864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584774.685106:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0711050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272568996608:12345-0@lo:400:kworker.0 Request processed in 51us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584774.685113:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1784584774.685136:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272568996864:12345-0@lo:400:kworker.0 Request processed in 59us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584774.685159:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272568996608:0@lo:400:kworker.0 00000100:00100000:2.0:1784584774.685284:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1784584774.685301:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784584774.685308:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272568997120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584774.685415:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272568997120:12345-0@lo:400:kworker.0 Request processed in 106us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584774.685421:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784584774.685436:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1784584774.685441:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568996736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584774.685470:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272568996736:12345-0@lo:400:kworker.0 Request processed in 29us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584774.685482:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1784584774.685507:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584774.685528:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2276300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272568996736:0@lo:400:kworker.0 00000100:00100000:2.0:1784584774.685539:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272568997120:0@lo:400:kworker.0 00000100:00100000:2.0:1784584774.685571:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2275c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272568996864:0@lo:400:kworker.0 00000100:00100000:3.0:1784584774.685947:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568996992 00000100:00100000:3.0:1784584774.686001:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784584774.686010:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568996992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584774.686054:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272568996992:12345-0@lo:400:kworker.0 Request processed in 45us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584774.686061:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1784584774.686095:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c801b0e300 x1871272568996992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584774.686107:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272568996992:0@lo:400:kworker.0 00000100:00080000:1.0:1784584774.686216:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784584774.940879:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784584774.983299:0:11527:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7ff4a860 20000000:00000080:1.0:1784584774.983315:0:11527:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c7f420f400 uarg=0000000000000000 20000000:01000000:1.0:1784584774.983344:0:11527:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1784584774.983354:0:11527:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1784584774.983359:0:11527:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1784584774.984542:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1784584774.986298:0:11527:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1784584774.993422:0:11527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1784584774.993482:0:11527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1784584774.993537:0:11527:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1784584774.993555:0:11527:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1784584774.993574:0:11527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.993826:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dc9 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.993836:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd0 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.993844:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1073 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.993850:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1081 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.993856:0:11527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff108f expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.993863:0:11527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.993900:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff108f expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.993914:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff108f expref: 18 pid: 5799 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584774.993935:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0735c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568997248:0@lo:104: 00000100:00100000:1.0:1784584774.993994:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784584774.994107:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff1081 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.994115:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff1081 expref: 18 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584774.994137:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d0737480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568997376:0@lo:104: 00000100:00100000:1.0:1784584774.994257:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1784584774.994497:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff1073 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584774.994507:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff1073 expref: 18 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584774.994516:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2276300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568997504:0@lo:104: 00000100:00100000:1.0:1784584774.994544:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584774.994560:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568997248 00000100:00100000:2.0:1784584774.994567:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568997248 00000100:00100000:2.0:1784584774.994603:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568997376 00000100:00100000:2.0:1784584774.994606:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568997376 00000100:00100000:2.0:1784584774.994621:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784584774.994640:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+4:11527:x1871272568997248:12345-0@lo:104: 00010000:00010000:2.0:1784584774.994652:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.994728:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784584774.994734:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+4:11527:x1871272568997248:12345-0@lo:104: Request processed in 107us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584774.994741:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1784584774.994757:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784584774.994763:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:11527:x1871272568997376:12345-0@lo:104: 00010000:00010000:2.0:1784584774.994770:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.994800:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784584774.994812:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:11527:x1871272568997376:12345-0@lo:104: Request processed in 49us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584774.994817:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1784584774.994837:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584774.994842:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.994849:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818c00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584774.994853:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.994862:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584774.994868:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584774.994873:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584774.994899:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.994905:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584774.994924:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.994931:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c801818c00/0x787d778cc3ff108f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1096 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.994943:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584774.994946:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.994963:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584774.994966:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.994972:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584774.994978:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584774.994983:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584774.994996:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.995002:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584774.995016:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.995022:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff1081 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff1088 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.995031:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584774.995033:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584774.995034:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584774.995040:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584774.995057:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568997632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584774.995084:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584774.995420:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568997760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584774.995456:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584774.995487:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568997632 00000100:00100000:2.0:1784584774.995492:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568997632 00010000:00010000:2.0:1784584774.995510:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff108f expref: 19 pid: 5799 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584774.995529:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568997760 00000100:00100000:2.0:1784584774.995531:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568997760 00010000:00010000:2.0:1784584774.995541:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff1081 expref: 20 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584774.995558:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584774.995565:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+20:3323:x1871272568997632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584774.995574:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584774.995579:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff108f expref: 20 pid: 5799 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.995589:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff108f expref: 20 pid: 5799 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.995605:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584774.995641:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+20:3323:x1871272568997632:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584774.995647:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584774.995660:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784584774.995666:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568997760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584774.995673:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584774.995677:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff1081 expref: 19 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.995723:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff1081 expref: 19 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584774.995733:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584774.995759:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaeb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272568997760:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584774.995765:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784584774.995808:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272568997632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584774.995832:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272568997760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584775.006026:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd0 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.006049:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd0 expref: 12 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584775.006064:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568997888:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584775.006119:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568997504 00000100:00100000:3.0:1784584775.006128:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568997504 00010000:00010000:1.0:1784584775.006176:0:11527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dc9 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.006204:0:11527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dc9 expref: 12 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584775.006213:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568998016:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584775.006241:0:11527:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c414b780 going to sleep for 10 seconds 00010000:00010000:1.0:1784584775.006265:0:11527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42be600/0x787d778cc3ff1096 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff108f expref: 18 pid: 5799 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584775.006278:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0735c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568997248:0@lo:104: 00010000:00010000:1.0:1784584775.006302:0:11527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42be200/0x787d778cc3ff1088 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff1081 expref: 17 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584775.006310:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d0737480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568997376:0@lo:104: 00000100:00100000:2.0:1784584775.006331:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784584775.006345:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801aca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:11527:x1871272568997504:12345-0@lo:104: 00010000:00010000:2.0:1784584775.006359:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584775.006428:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784584775.006434:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801aca450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c4006421-7015-489e-aaaa-81e9219afdea+3:11527:x1871272568997504:12345-0@lo:104: Request processed in 94us (11890us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584775.006441:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1784584775.006485:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584775.006491:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584775.006499:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c13fc400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584775.006504:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584775.006524:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584775.006532:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584775.006537:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584775.006571:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584775.006577:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584775.006595:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584775.006602:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c13fc400/0x787d778cc3ff1073 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff107a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584775.006616:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584775.006617:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584775.006619:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584775.006641:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568998144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584775.006671:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584775.006740:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568998144 00000100:00100000:2.0:1784584775.006745:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568998144 00010000:00010000:2.0:1784584775.006764:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff1073 expref: 17 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584775.006800:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784584775.006806:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+17:3321:x1871272568998144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584775.006824:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584775.006830:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff1073 expref: 17 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584775.006839:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff1073 expref: 17 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584775.006855:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584775.006890:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a83450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+17:3321:x1871272568998144:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584775.006897:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784584775.007164:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272568998144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584775.007185:0:11527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff107a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff1073 expref: 16 pid: 5798 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584775.007197:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2276300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568997504:0@lo:104: 00000100:00100000:1.0:1784584775.009172:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2274380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568997888:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584775.009187:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11527:1871272568998016:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584775.009224:0:11527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584775.016384:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584775.016462:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584775.017021:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549044608 00000100:00100000:2.0:1784584775.017032:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549044608 00010000:00010000:2.0:1784584775.017072:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dc9 expref: 13 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584775.017320:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549044480 00000100:00100000:3.0:1784584775.017325:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549044480 00010000:00010000:3.0:1784584775.017345:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd0 expref: 14 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584775.017378:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1784584775.017387:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+14:2354:x1871272549044608:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584775.017402:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584775.017408:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dc9 expref: 14 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017418:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dc9 expref: 14 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017435:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff1065 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dc9 expref: 14 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017468:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584775.017526:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549044608:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 140us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584775.017534:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1784584775.017554:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1784584775.017561:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:2354:x1871272549044480:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584775.017569:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584775.017574:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd0 expref: 12 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017584:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd0 expref: 12 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017595:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff106c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2dd0 expref: 12 pid: 5798 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017608:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017615:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017640:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017648:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017666:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017673:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.017679:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584775.017683:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.020875:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.020997:0:11527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.021006:0:11527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.021076:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.021086:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c801819200/0x787d778cc3ff11c3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584775.021104:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584775.021736:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:2354:x1871272549044480:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 4100us (5199us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584775.021747:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:0.0:1784584775.620317:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584775.620688:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584775.620756:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584775.620853:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549044736 00000100:00100000:3.0:1784584775.620863:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549044736 00000100:00100000:1.0:1784584775.620910:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549044992 00000100:00100000:1.0:1784584775.620917:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549044992 00000100:00100000:3.0:1784584775.620935:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:3.0:1784584775.620948:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:2354:x1871272549044736:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584775.620960:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:1.0:1784584775.620972:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549044992:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584775.621038:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:2354:x1871272549044736:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 92us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584775.621045:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:1.0:1784584775.621105:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549044992:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 134us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584775.621113:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00080000:0.0:1784584775.621349:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584775.623296:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549044864 00000100:00100000:2.0:1784584775.623310:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549044864 00000100:00080000:0.0:1784584775.623459:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584775.623515:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1784584775.623525:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2354:x1871272549044864:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584775.623605:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2354:x1871272549044864:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 81us (3298us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584775.623612:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000001:00080000:0.0:1784584775.754578:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:0.0:1784584775.754754:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1784584775.755273:0:11544:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1784584775.755636:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784584775.755659:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568998272:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1784584775.755764:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584775.755841:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568998272 00000100:00100000:1.0:1784584775.755849:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568998272 00000100:00100000:1.0:1784584775.755899:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784584775.755909:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272568998272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784584775.755939:0:8782:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1784584775.755979:0:8782:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a5e9a42, atime: 0x6a5e9a42, ctime: 0x6a5e9a42, blocks: 0x1 00010000:00010000:1.0:1784584775.755987:0:8782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.756005:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=270s v=(0 0) 00010000:00010000:1.0:1784584775.756010:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584775.756029:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.756064:0:8782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.756083:0:8782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.756092:0:8782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.756112:0:8782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784584775.756914:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3323:x1871272568998272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1001us (1145us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784584775.756924:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1784584775.756958:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584775.756966:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.756977:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819800 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584775.756982:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.756992:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.757020:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.757028:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006efb0dcf/0x787d778cc3ff11ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584775.757048:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584775.757050:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584775.757051:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784584775.757620:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7f3f03480/2, rc 0, transno 4294967300 00000100:00100000:1.0:1784584775.757637:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272568998272:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1784584775.965754:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584776.197362:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584776.197479:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549045120 00000100:00100000:1.0:1784584776.197489:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549045120 00000100:00100000:1.0:1784584776.197549:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 244 00000100:00100000:1.0:1784584776.197559:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:5570:x1871272549045120:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584776.197574:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584776.197595:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801819800/0x787d778cc3ff11d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e1d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.197633:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801819800/0x787d778cc3ff11d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e1d expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.197644:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801819800/0x787d778cc3ff11d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e1d expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.197652:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819800, rc 0) 00000100:00100000:1.0:1784584776.197761:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549045120:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 202us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.197767:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 244 00000100:00100000:3.0:1784584776.199799:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584776.199993:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549045248 00000100:00100000:0.0:1784584776.200003:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549045248 00000100:00100000:0.0:1784584776.200063:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:0.0:1784584776.200074:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549045248:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584776.200375:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549045248:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 294us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584776.200385:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 245 00000100:00100000:0.0:1784584776.204354:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584776.204455:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549045376 00000100:00100000:2.0:1784584776.204466:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549045376 00000100:00100000:2.0:1784584776.204525:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:2.0:1784584776.204536:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549045376:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584776.204814:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549045376:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 279us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584776.204823:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 246 00000100:00100000:3.0:1784584776.208178:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584776.208387:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549045504 00000100:00100000:1.0:1784584776.208395:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549045504 00000100:00100000:1.0:1784584776.208449:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:1.0:1784584776.208458:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:9919:x1871272549045504:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784584776.208836:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:9919:x1871272549045504:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 377us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.208845:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 247 00000100:00100000:3.0:1784584776.210928:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584776.211012:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549045632 00000100:00100000:0.0:1784584776.211019:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549045632 00000100:00100000:0.0:1784584776.211080:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:0.0:1784584776.211089:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:9919:x1871272549045632:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584776.211529:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:9919:x1871272549045632:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 439us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584776.211537:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 248 00000100:00100000:0.0:1784584776.217255:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584776.218757:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549045760 00000100:00100000:1.0:1784584776.218770:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549045760 00000100:00100000:1.0:1784584776.218836:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:1.0:1784584776.218846:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:5570:x1871272549045760:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584776.218864:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584776.218883:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801818e00/0x787d778cc3ff11d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e24 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.218912:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801818e00/0x787d778cc3ff11d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e24 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.218923:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801818e00/0x787d778cc3ff11d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e24 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.218932:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818e00, rc 0) 00000100:00100000:1.0:1784584776.218999:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549045760:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 154us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.219023:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 249 00000100:00100000:1.0:1784584776.226550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584776.226626:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549045888 00000100:00100000:3.0:1784584776.226636:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549045888 00000100:00100000:3.0:1784584776.226674:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:3.0:1784584776.226683:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549045888:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584776.226899:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0712450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549045888:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 216us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584776.226907:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 250 00000100:00100000:0.0:1784584776.229374:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584776.229529:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549046016 00000100:00100000:3.0:1784584776.229539:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549046016 00000100:00100000:3.0:1784584776.229597:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:3.0:1784584776.229609:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549046016:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584776.230537:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:5570:x1871272549046016:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 927us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584776.230546:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 251 00000100:00100000:0.0:1784584776.243902:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584776.244058:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549046144 00000100:00100000:3.0:1784584776.244068:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549046144 00000100:00100000:3.0:1784584776.244123:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:3.0:1784584776.244134:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:9922:x1871272549046144:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584776.244336:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:9922:x1871272549046144:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 202us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584776.244344:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 252 00000100:00100000:1.0:1784584776.248384:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584776.248419:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549046272 00000100:00100000:1.0:1784584776.248428:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549046272 00000100:00100000:1.0:1784584776.248469:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 253 00000100:00100000:1.0:1784584776.248478:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:9922:x1871272549046272:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784584776.248722:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0710450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:9922:x1871272549046272:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 243us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.248730:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 253 00000001:00080000:3.0:1784584776.253427:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 10000000:01000000:0.0:1784584776.283805:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784584776.283812:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7fceca000 from 7 10000000:01000000:0.0:1784584776.283818:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784584776.283864:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584776.283876:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584776.283888:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584776.283912:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568998400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784584776.283984:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584776.284579:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568998400 00000100:00100000:3.0:1784584776.284588:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568998400 00000100:00100000:0.0:1784584776.284673:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4246540 going to sleep for 11 seconds 00000100:00100000:1.0:1784584776.285444:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784584776.285458:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+16:5803:x1871272568998400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584776.285474:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584776.285490:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801818400/0x787d778cc3ff11e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff11df expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.285515:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801818400/0x787d778cc3ff11e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff11df expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.285527:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801818400/0x787d778cc3ff11e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff11df expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.285536:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818400, rc 0) 00000100:00100000:1.0:1784584776.285669:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0711450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568998400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.285677:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1784584776.286019:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568998400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584776.286036:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584776.286047:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584776.286121:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568998528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584776.286153:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584776.286219:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4246540 going to sleep for 11 seconds 00000100:00100000:1.0:1784584776.286256:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568998528 00000100:00100000:1.0:1784584776.286262:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568998528 00000100:00100000:1.0:1784584776.286299:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784584776.286306:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568998528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.286834:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0713850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568998528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 526us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.286842:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1784584776.286904:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568998528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584776.286937:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568998656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584776.287042:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584776.287101:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4246540 going to sleep for 11 seconds 00000100:00100000:1.0:1784584776.287136:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568998656 00000100:00100000:1.0:1784584776.287140:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568998656 00000100:00100000:1.0:1784584776.287207:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784584776.287215:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568998656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.287363:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6561c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568998656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.287370:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1784584776.287450:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568998656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584776.288003:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11545:1871272568998784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584776.288044:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584776.288414:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4246600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584776.288481:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568998784 00000100:00100000:2.0:1784584776.288488:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568998784 00000100:00100000:2.0:1784584776.288527:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1784584776.288536:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:11545:x1871272568998784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584776.288898:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6561050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:11545:x1871272568998784:12345-0@lo:502:llog_process_th.0 Request processed in 362us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584776.288906:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784584776.289185:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11545:1871272568998784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784584776.289211:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584776.289220:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584776.289223:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784584776.289230:0:11545:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c7fceca000 00000020:00000080:0.0:1784584776.289233:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784584776.289343:0:11545:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11545:1871272568998912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584776.289379:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584776.289414:0:11545:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4246600 going to sleep for 11 seconds 00000100:00100000:1.0:1784584776.289462:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568998912 00000100:00100000:1.0:1784584776.289467:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568998912 00000100:00100000:1.0:1784584776.289504:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784584776.289511:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:11545:x1871272568998912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584776.289663:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6563050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:11545:x1871272568998912:12345-0@lo:502:llog_process_th.0 Request processed in 152us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.289670:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1784584776.289717:0:11545:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11545:1871272568998912:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784584776.289731:0:11545:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584776.289734:0:11545:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584776.289735:0:11545:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784584776.289738:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784584776.289778:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1784584776.289795:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584776.289801:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.289809:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584776.289815:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584776.289817:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7c7f3c000 from 7 10000000:01000000:1.0:1784584776.289818:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584776.289835:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.289841:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.289846:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584776.289855:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.289874:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584776.289886:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4269c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584776.289893:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568999040 00000100:00100000:1.0:1784584776.289895:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568999040 00000100:00100000:1.0:1784584776.289906:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784584776.289910:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+17:5803:x1871272568999040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584776.289915:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584776.289923:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801819400/0x787d778cc3ff11f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff11ed expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.290059:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801819400/0x787d778cc3ff11f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff11ed expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.290069:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801819400/0x787d778cc3ff11f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff11ed expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.290077:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819400, rc 0) 00000100:00100000:1.0:1784584776.290107:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568999040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.290113:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1784584776.290142:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584776.290153:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584776.290162:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584776.290202:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.290225:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584776.290238:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c3906180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584776.290248:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568999168 00000100:00100000:1.0:1784584776.290251:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568999168 00000100:00100000:1.0:1784584776.290267:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784584776.290272:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568999168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.290464:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568999168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.290479:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1784584776.290509:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.290533:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.290564:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584776.290577:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c3906180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584776.290703:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568999296 00000100:00100000:0.0:1784584776.290709:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568999296 00000100:00100000:0.0:1784584776.290730:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784584776.290736:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568999296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584776.292387:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568999296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1645us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584776.292397:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1784584776.292535:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.293576:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11546:1871272568999424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584776.293648:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584776.293686:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584776.293824:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568999424 00000100:00100000:2.0:1784584776.293831:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568999424 00000100:00100000:2.0:1784584776.293873:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1784584776.293881:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:11546:x1871272568999424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584776.294506:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:11546:x1871272568999424:12345-0@lo:502:llog_process_th.0 Request processed in 624us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584776.294514:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1784584776.294591:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11546:1871272568999424:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784584776.294629:0:11546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584776.294638:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584776.294640:0:11546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784584776.294648:0:11546:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c7c7f3c000 00000020:00000080:1.0:1784584776.294650:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784584776.295253:0:11546:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11546:1871272568999552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584776.295299:0:11546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584776.295381:0:11546:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584776.296343:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568999552 00000100:00100000:0.0:1784584776.296351:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568999552 00000100:00100000:0.0:1784584776.296402:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784584776.296410:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:11546:x1871272568999552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584776.296614:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+18:11546:x1871272568999552:12345-0@lo:502:llog_process_th.0 Request processed in 204us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584776.296633:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784584776.296844:0:11546:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11546:1871272568999552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784584776.296883:0:11546:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584776.296890:0:11546:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584776.296892:0:11546:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784584776.296898:0:11546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1784584776.297344:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1784584776.297365:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584776.297376:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584776.297387:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584776.297397:0:5803:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784584776.297408:0:5803:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7d687f000 from 7 10000000:01000000:2.0:1784584776.297411:0:5803:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784584776.297440:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584776.297448:0:5803:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584776.297457:0:5803:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584776.297476:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584776.297516:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584776.297582:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c656bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584776.297671:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568999680 00000100:00100000:0.0:1784584776.297677:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568999680 00000100:00100000:0.0:1784584776.297905:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784584776.297915:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+18:5803:x1871272568999680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584776.297933:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584776.297950:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff1202 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff11fb expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584776.297972:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff1202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff11fb expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584776.297981:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff1202 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff11fb expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584776.297996:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf600, rc 0) 00000100:00100000:0.0:1784584776.298061:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568999680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584776.298068:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784584776.298629:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584776.298647:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584776.298656:0:5803:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584776.298794:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584776.298824:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584776.298885:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4246540 going to sleep for 11 seconds 00000100:00100000:2.0:1784584776.299294:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568999808 00000100:00100000:2.0:1784584776.299301:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568999808 00000100:00100000:2.0:1784584776.299371:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784584776.299380:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568999808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584776.299628:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568999808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584776.299635:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784584776.299723:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.299758:0:5803:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584776.299797:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584776.299901:0:5803:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584776.299935:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272568999936 00000100:00100000:0.0:1784584776.299940:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272568999936 00000100:00100000:0.0:1784584776.299961:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1784584776.299967:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568999936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584776.300381:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:5803:x1871272568999936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 413us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584776.300389:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1784584776.301562:0:5803:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c4006421-7015-489e-aaaa-81e9219afdea:5803:1871272568999936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584776.301916:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f02680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11549:1871272569000064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584776.302557:0:11549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584776.302601:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c64d73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584776.302662:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569000064 00000100:00100000:1.0:1784584776.302669:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569000064 00000100:00100000:1.0:1784584776.302744:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784584776.302752:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:11549:x1871272569000064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584776.302950:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:11549:x1871272569000064:12345-0@lo:502:llog_process_th.0 Request processed in 198us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.302958:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1784584776.303019:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f02680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11549:1871272569000064:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784584776.303054:0:11549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584776.303062:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584776.303064:0:11549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784584776.303071:0:11549:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c7d687f000 00000020:00000080:1.0:1784584776.303073:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784584776.303465:0:11549:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11549:1871272569000192:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584776.303501:0:11549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584776.303523:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569000192 00000100:00100000:1.0:1784584776.303527:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569000192 00000100:00100000:1.0:1784584776.303548:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784584776.303555:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:11549:x1871272569000192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584776.304510:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:11549:x1871272569000192:12345-0@lo:502:llog_process_th.0 Request processed in 950us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584776.304518:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1784584776.304569:0:11549:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584776.304587:0:11549:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c4006421-7015-489e-aaaa-81e9219afdea:11549:1871272569000192:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784584776.304610:0:11549:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584776.304631:0:11549:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584776.304633:0:11549:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784584776.304637:0:11549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1784584776.304741:0:5803:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1784584776.304761:0:5803:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584776.304771:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584776.304782:0:5803:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784584776.310341:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784584776.731972:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569000320:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584776.732050:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584776.732287:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569000320 00000100:00100000:2.0:1784584776.732309:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569000320 00000100:00100000:2.0:1784584776.732373:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784584776.732382:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569000320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584776.732418:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584776.732474:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569000320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584776.732481:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784584776.732741:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1784584776.732746:0:3323:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7f3f03480, transno 4294967300 00000100:00100000:1.0:1784584776.732769:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaeb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569000320:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784584776.733248:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784584776.987846:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584777.372514:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784584778.011973:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584779.035997:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584779.804625:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569000704:0@lo:400:kworker.0 00000100:00100000:0.0:1784584779.804715:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584779.804768:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569000832:0@lo:400:kworker.0 00000100:00100000:1.0:1784584779.804804:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584779.804811:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569001216:0@lo:400:kworker.0 00000100:00100000:1.0:1784584779.804835:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584779.804844:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569000960:0@lo:400:kworker.0 00000100:00100000:3.0:1784584779.804922:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569000576:0@lo:400:kworker.0 00000100:00100000:0.0:1784584779.805335:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584779.805402:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569001216 00000100:00100000:0.0:1784584779.805409:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569001216 00000100:00100000:0.0:1784584779.805462:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784584779.805472:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569001216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584779.805525:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569001216:12345-0@lo:400:kworker.0 Request processed in 54us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584779.805533:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:0.0:1784584779.805554:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784584779.805586:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7faae9500 x1871272569001216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584779.805612:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569001216:0@lo:400:kworker.0 00000100:00100000:2.0:1784584779.807419:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569000704 00000100:00100000:2.0:1784584779.807430:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569000704 00000100:00100000:2.0:1784584779.807491:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569000832 00000100:00100000:2.0:1784584779.807495:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569000832 00000100:00100000:2.0:1784584779.807533:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1784584779.807543:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569000704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584779.807653:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569000704:12345-0@lo:400:kworker.0 Request processed in 111us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584779.807660:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1784584779.807682:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1784584779.807772:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569000832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584779.807813:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569000832:12345-0@lo:400:kworker.0 Request processed in 122us (3008us total) trans 0 rc 0/0 00000100:00080000:2.0:1784584779.810419:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584779.810480:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569000704:0@lo:400:kworker.0 00000100:00100000:0.0:1784584779.810529:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1784584779.814204:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584779.814276:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569000448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584779.814307:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569000576 00000100:00100000:2.0:1784584779.814314:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584779.814317:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569000576 00000100:00100000:2.0:1784584779.814338:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569001088:0@lo:400:kworker.0 00000100:00100000:2.0:1784584779.814397:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584779.814419:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569001088 00000100:00100000:2.0:1784584779.814422:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569001088 00000100:00100000:2.0:1784584779.814472:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1784584779.814494:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569001088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584779.814555:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569001088:12345-0@lo:400:kworker.0 Request processed in 59us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584779.814563:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1784584779.814568:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1784584779.814579:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272569000576:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784584779.814591:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584779.814631:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569001088:0@lo:400:kworker.0 00000100:00100000:0.0:1784584779.814639:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272569000576:12345-0@lo:400:kworker.0 Request processed in 60us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584779.814646:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1784584779.814652:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584779.814671:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569000576:0@lo:400:kworker.0 00000100:00100000:0.0:1784584779.814732:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569000960 00000100:00100000:0.0:1784584779.814737:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569000960 00000100:00080000:2.0:1784584779.814829:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584779.814838:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784584779.814847:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569000960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584779.814881:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569000960:12345-0@lo:400:kworker.0 Request processed in 36us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584779.814886:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784584779.814939:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569000448 00000100:00100000:3.0:1784584779.814944:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569000448 00000100:00100000:3.0:1784584779.814979:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784584779.814986:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569000448:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584779.814996:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569000960:0@lo:400:kworker.0 00002000:00000024:3.0:1784584779.815014:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584779.815021:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569000832:0@lo:400:kworker.0 00000100:00100000:3.0:1784584779.815289:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569000448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 303us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584779.815297:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1784584779.815406:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7d8aaf800 x1871272569000448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584779.815423:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569000448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784584780.061417:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584780.739307:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584780.739350:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584780.739399:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584780.739440:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584780.739475:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549046656 00000100:00100000:3.0:1784584780.739484:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549046656 00000100:00100000:3.0:1784584780.739549:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1784584780.739577:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549046656:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584780.739645:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549046528 00000100:00100000:0.0:1784584780.739651:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549046528 00000100:00100000:3.0:1784584780.739660:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549046656:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 101us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584780.739681:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1784584780.739686:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549046784 00000100:00100000:0.0:1784584780.739722:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549046784 00000100:00100000:0.0:1784584780.739750:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1784584780.739759:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549046528:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584780.739792:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549046528:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 34us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584780.739799:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1784584780.739813:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:0.0:1784584780.739819:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549046784:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584780.739841:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549046784:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 23us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584780.739847:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:1.0:1784584780.739973:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549046400 00000100:00100000:1.0:1784584780.739978:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549046400 00000100:00100000:1.0:1784584780.740014:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 270 00000100:00100000:1.0:1784584780.740021:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549046400:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584780.740051:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4105050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549046400:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584780.740057:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 270 00000100:00080000:2.0:1784584780.740533:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584780.740540:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784584781.084949:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584781.852318:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584781.852348:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569001344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584781.852432:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584781.852464:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569001344 00000100:00100000:3.0:1784584781.852476:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569001344 00000100:00100000:3.0:1784584781.852540:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784584781.852549:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569001344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584781.852595:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584781.852656:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569001344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584781.852663:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784584781.852745:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faaeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569001344:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784584781.853135:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784584782.108253:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584783.131972:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584784.158020:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584784.924048:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569001472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584784.924130:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584784.924283:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569001472 00000100:00100000:0.0:1784584784.924291:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569001472 00000100:00100000:0.0:1784584784.924350:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784584784.924359:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569001472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584784.924389:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584784.924429:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569001472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584784.924435:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1784584784.924492:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784584784.924551:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7d8aae680 x1871272569001472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584784.924584:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569001472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584784.925509:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569001728:0@lo:400:kworker.0 00000100:00100000:2.0:1784584784.925553:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584784.925601:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1784584784.925608:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569001600:0@lo:400:kworker.0 00000100:00100000:2.0:1784584784.925639:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584784.925669:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272569002112:0@lo:400:kworker.0 00000100:00100000:2.0:1784584784.925718:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584784.925746:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569001728 00000100:00100000:2.0:1784584784.925752:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569001728 00000100:00100000:2.0:1784584784.925784:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569002112 00000100:00100000:2.0:1784584784.925788:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569002112 00000100:00100000:2.0:1784584784.925814:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784584784.925850:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784584784.925861:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272569002112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584784.925918:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272569002112:12345-0@lo:400:kworker.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584784.925924:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1784584784.925961:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272569002112:0@lo:400:kworker.0 00000100:00080000:3.0:1784584784.925998:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584784.926001:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569001728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584784.926056:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569001728:12345-0@lo:400:kworker.0 Request processed in 235us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584784.926078:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1784584784.926149:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569001856:0@lo:400:kworker.0 00000100:00100000:1.0:1784584784.926178:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584784.926207:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584784.926212:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569001984:0@lo:400:kworker.0 00000100:00100000:1.0:1784584784.926240:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584784.926257:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569001728:0@lo:400:kworker.0 00000100:00100000:1.0:1784584784.926276:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569001984 00000100:00100000:1.0:1784584784.926281:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569001984 00000100:00100000:1.0:1784584784.926329:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1784584784.926336:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569001984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584784.926370:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569001984:12345-0@lo:400:kworker.0 Request processed in 35us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584784.926376:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1784584784.926392:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584784.926408:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569001984:0@lo:400:kworker.0 00000100:00100000:2.0:1784584784.927088:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569001856 00000100:00100000:2.0:1784584784.927094:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569001856 00000100:00100000:2.0:1784584784.927145:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1784584784.927153:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569001856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584784.927201:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569001856:12345-0@lo:400:kworker.0 Request processed in 49us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584784.927208:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1784584784.927285:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569001600 00000100:00100000:0.0:1784584784.927291:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569001600 00000100:00100000:0.0:1784584784.927328:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1784584784.927335:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569001600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584784.927374:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569001600:12345-0@lo:400:kworker.0 Request processed in 39us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584784.927381:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1784584784.927402:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569001600:0@lo:400:kworker.0 00000100:00080000:1.0:1784584784.927583:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584784.927607:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569001856:0@lo:400:kworker.0 00010000:00010000:1.0:1784584785.179990:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584785.860026:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584785.860066:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584785.860108:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584785.860154:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584785.860213:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549047040 00000100:00100000:2.0:1784584785.860223:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549047040 00000100:00100000:3.0:1784584785.860280:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549047296 00000100:00100000:3.0:1784584785.860286:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549047296 00000100:00100000:2.0:1784584785.860300:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:2.0:1784584785.860313:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549047040:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584785.860328:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:3.0:1784584785.860338:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549047296:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:1.0:1784584785.860404:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584785.860438:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549047168 00000100:00100000:1.0:1784584785.860443:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549047168 00000100:00100000:0.0:1784584785.860467:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549046912 00000100:00100000:0.0:1784584785.860473:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549046912 00000100:00100000:1.0:1784584785.860484:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:1.0:1784584785.860494:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549047168:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584785.860508:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 272 00000100:00100000:0.0:1784584785.860517:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549046912:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584785.860564:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549047040:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 240us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584785.860574:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:3.0:1784584785.864600:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549047296:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4253us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584785.864617:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00080000:3.0:1784584785.864688:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584785.866589:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549047168:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 6086us (6423us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584785.866603:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1784584785.868852:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4104c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549046912:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 8324us (8730us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584785.868866:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 272 00010000:00010000:3.0:1784584786.204803:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584786.971942:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584786.971968:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569002240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584786.972040:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584786.972285:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569002240 00000100:00100000:1.0:1784584786.972294:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569002240 00000100:00100000:1.0:1784584786.972393:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784584786.972403:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569002240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784584786.972438:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584786.972489:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569002240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584786.972496:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1784584786.972560:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584786.972671:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569002240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1784584787.227851:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784584787.612419:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784584788.251959:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584789.275854:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584790.044829:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569002496:0@lo:400:kworker.0 00000100:00100000:1.0:1784584790.044847:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569002624:0@lo:400:kworker.0 00000100:00100000:1.0:1784584790.044899:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584790.044907:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569002752:0@lo:400:kworker.0 00000100:00100000:3.0:1784584790.044953:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584790.045001:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569002624 00000100:00100000:1.0:1784584790.045009:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569002624 00000100:00100000:3.0:1784584790.045020:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584790.045054:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569003008:0@lo:400:kworker.0 00000100:00100000:1.0:1784584790.045072:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569002496 00000100:00100000:1.0:1784584790.045077:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569002496 00000100:00100000:3.0:1784584790.045083:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584790.045105:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784584790.045107:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784584790.045114:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569002368:0@lo:400:kworker.0 00000100:00100000:1.0:1784584790.045119:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569002624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584790.045146:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584790.045172:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569002880:0@lo:400:kworker.0 00000100:00100000:1.0:1784584790.045193:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569002624:12345-0@lo:400:kworker.0 Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584790.045201:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584790.045203:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784584790.045222:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569002880 00000100:00100000:1.0:1784584790.045226:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569002880 00000100:00100000:3.0:1784584790.045245:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784584790.045255:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569002496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584790.045294:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569002496:12345-0@lo:400:kworker.0 Request processed in 41us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584790.045398:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569002752 00000100:00100000:0.0:1784584790.045402:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569002752 00000100:00100000:0.0:1784584790.045430:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569003008 00000100:00100000:0.0:1784584790.045433:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569003008 00000100:00100000:0.0:1784584790.045450:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784584790.045457:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569002752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584790.045489:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569002752:12345-0@lo:400:kworker.0 Request processed in 34us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584790.045506:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784584790.045522:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784584790.045535:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569003008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584790.045567:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569003008:12345-0@lo:400:kworker.0 Request processed in 39us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584790.045573:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784584790.045784:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569003136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584790.045810:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584790.045840:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569002624:0@lo:400:kworker.0 00000100:00100000:0.0:1784584790.045864:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569003136 00000100:00100000:0.0:1784584790.045867:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569003136 00000100:00100000:0.0:1784584790.045888:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784584790.045894:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569003136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584790.045917:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584790.045983:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569003136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584790.045989:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1784584790.046022:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7d8aaea00 x1871272569003136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584790.046035:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569003136:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784584790.046112:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784584790.046117:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784584790.046119:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584790.046912:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784584790.046928:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569002880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584790.046975:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569002880:12345-0@lo:400:kworker.0 Request processed in 55us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584790.046981:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784584790.047017:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569002368 00000100:00100000:1.0:1784584790.047022:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569002368 00000100:00100000:1.0:1784584790.047046:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1784584790.047052:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272569002368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584790.047164:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784584790.047205:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569002752:0@lo:400:kworker.0 00000100:00100000:3.0:1784584790.047317:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569002880:0@lo:400:kworker.0 00010000:00080000:3.0:1784584790.047330:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7c5395880 x1871272569003008/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584790.047339:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569003008:0@lo:400:kworker.0 00000100:00100000:3.0:1784584790.047364:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569002496:0@lo:400:kworker.0 00000100:00100000:1.0:1784584790.048961:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4107050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272569002368:12345-0@lo:400:kworker.0 Request processed in 1904us (3810us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584790.048970:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1784584790.049214:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569002368:0@lo:400:kworker.0 00010000:00010000:3.0:1784584790.301084:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584790.983087:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584790.983209:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584790.983292:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549047424 00000100:00100000:0.0:1784584790.983302:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549047424 00000100:00100000:0.0:1784584790.983356:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 274 00000100:00100000:0.0:1784584790.983365:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c4106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549047424:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584790.983435:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c4106850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549047424:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 70us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584790.983442:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 274 00000100:00100000:2.0:1784584790.985588:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549047552 00000100:00100000:2.0:1784584790.985601:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549047552 00000100:00100000:2.0:1784584790.985727:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:2.0:1784584790.985736:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549047552:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584790.985818:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549047552:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 83us (2740us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584790.985825:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00080000:0.0:1784584790.987931:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584790.997795:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584790.998481:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549047680 00000100:00100000:0.0:1784584790.998491:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549047680 00000100:00100000:0.0:1784584790.998623:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:0.0:1784584790.998634:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2353:x1871272549047680:12345-192.168.203.52@tcp:9:kworker.0 00000020:00000080:0.0:1784584790.998663:0:6607:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff113e 00000100:00080000:0.0:1784584790.998671:0:6607:0:(import.c:65:import_set_state_nolock()) ffff97c801ae9000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784584790.998745:0:6607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1784584790.999020:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+2:2353:x1871272549047680:12345-192.168.203.52@tcp:9:kworker.0 Request processed in 376us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584790.999029:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:1.0:1784584791.001728:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784584791.005341:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584791.006281:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584791.006423:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549047808 00000100:00100000:2.0:1784584791.006433:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549047808 00000100:00100000:2.0:1784584791.006507:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:2.0:1784584791.006517:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549047808:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584791.006615:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549047808:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 99us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584791.006624:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00080000:3.0:1784584791.007201:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784584791.323919:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784584791.631808:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:3.0:1784584791.631816:0:6631:0:(genops.c:906:class_export_put()) final put ffff97c801aef000/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:1.0:1784584791.631887:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c801aef000/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 for lustre-OST0000 00000020:00000080:1.0:1784584791.632010:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c801ae9000 for lustre-OST0000 00000100:00100000:0.0:1784584792.092879:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584792.093011:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569003264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584792.093154:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584792.093595:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569003264 00000100:00100000:2.0:1784584792.093604:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569003264 00000100:00100000:2.0:1784584792.093683:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784584792.093714:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569003264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584792.093764:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584792.093823:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569003264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584792.093831:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784584792.093939:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569003264:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784584792.094432:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784584792.347844:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584793.372284:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584794.395891:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584795.164110:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569003520:0@lo:400:kworker.0 00000100:00100000:0.0:1784584795.164114:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569003648:0@lo:400:kworker.0 00000100:00100000:2.0:1784584795.164202:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569003392:0@lo:400:kworker.0 00000100:00100000:3.0:1784584795.165537:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584795.165651:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569004032:0@lo:400:kworker.0 00000100:00100000:3.0:1784584795.165687:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584795.165754:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569003776:0@lo:400:kworker.0 00000100:00100000:3.0:1784584795.165801:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584795.165852:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569004032 00000100:00100000:3.0:1784584795.165859:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569004032 00000100:00100000:3.0:1784584795.165908:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569003776 00000100:00100000:3.0:1784584795.165911:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569003776 00000100:00100000:3.0:1784584795.165934:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784584795.165943:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569004032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584795.166013:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569004032:12345-0@lo:400:kworker.0 Request processed in 70us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584795.166020:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784584795.166044:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784584795.166051:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569003776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584795.166087:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569003776:12345-0@lo:400:kworker.0 Request processed in 36us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584795.166093:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784584795.166132:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569003776:0@lo:400:kworker.0 00010000:00080000:3.0:1784584795.166162:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7c5397480 x1871272569004032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1784584811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584795.166173:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569004032:0@lo:400:kworker.0 00000100:00080000:3.0:1784584795.166213:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584795.166217:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784584795.166764:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569003520 00000100:00100000:1.0:1784584795.166770:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569003520 00000100:00100000:1.0:1784584795.166816:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784584795.166824:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569003520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584795.166874:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569003520:12345-0@lo:400:kworker.0 Request processed in 51us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584795.166880:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784584795.166912:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569003520:0@lo:400:kworker.0 00000100:00100000:0.0:1784584795.167811:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584795.168289:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569003648 00000100:00100000:3.0:1784584795.168297:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569003648 00000100:00100000:2.0:1784584795.168435:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584795.168444:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569004160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584795.168478:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584795.168617:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569004160 00000100:00100000:2.0:1784584795.168622:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569004160 00000100:00100000:2.0:1784584795.168751:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784584795.168754:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1784584795.168767:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569003648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584795.168825:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569003648:12345-0@lo:400:kworker.0 Request processed in 62us (1017us total) trans 0 rc 0/0 00000100:00080000:1.0:1784584795.168915:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584795.168978:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569004160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584795.168994:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569003392 00000100:00100000:1.0:1784584795.168999:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569003392 00002000:00000024:2.0:1784584795.169013:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584795.169035:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1784584795.169044:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272569003392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584795.169055:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569004160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 294us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584795.169063:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784584795.169093:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272569003392:12345-0@lo:400:kworker.0 Request processed in 50us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584795.169101:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00080000:0.0:1784584795.169324:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7d8aad880 x1871272569004160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584795.169343:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569004160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584795.169369:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569003648:0@lo:400:kworker.0 00000100:00100000:3.0:1784584795.169589:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784584795.169905:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569003392:0@lo:400:kworker.0 00000100:00100000:2.0:1784584795.169916:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569003904:0@lo:400:kworker.0 00000100:00100000:2.0:1784584795.170066:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584795.170153:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569003904 00000100:00100000:1.0:1784584795.170158:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569003904 00000100:00100000:1.0:1784584795.170272:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1784584795.170279:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272569003904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584795.170327:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272569003904:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584795.170334:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1784584795.170393:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584795.170490:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569003904:0@lo:400:kworker.0 00010000:00010000:3.0:1784584795.425376:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584796.100768:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584796.100808:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584796.100839:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584796.100886:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549048192 00000100:00100000:0.0:1784584796.100886:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549048064 00000100:00100000:0.0:1784584796.100896:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549048064 00000100:00100000:2.0:1784584796.100904:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549048192 00000100:00100000:3.0:1784584796.100956:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549047936 00000100:00100000:3.0:1784584796.100961:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549047936 00000100:00100000:0.0:1784584796.101021:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:0.0:1784584796.101032:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549048064:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584796.101101:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549048064:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 72us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584796.101110:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:3.0:1784584796.101273:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 276 00000100:00100000:2.0:1784584796.101279:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:3.0:1784584796.101285:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549047936:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584796.101293:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549048192:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584796.101326:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549047936:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 44us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584796.101334:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549048192:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 44us (524us total) trans 0 rc 0/0 00000100:00080000:1.0:1784584796.101348:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584796.101352:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:3.0:1784584796.101353:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 276 00010000:00010000:1.0:1784584796.444062:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584797.214626:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569004288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584797.214720:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584797.214787:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569004288 00000100:00100000:0.0:1784584797.214793:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569004288 00000100:00100000:0.0:1784584797.214845:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784584797.214855:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569004288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784584797.214895:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584797.214938:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569004288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584797.214945:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784584797.214990:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569004288:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1784584797.215134:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784584797.468445:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584797.854998:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784584798.491914:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784584798.508278:0:11713:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 17:59:56 (1784584796) 00010000:00010000:3.0:1784584799.519250:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584800.165952:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584800.166109:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549048320 00000100:00100000:0.0:1784584800.166119:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549048320 00000100:00100000:0.0:1784584800.166199:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:0.0:1784584800.166217:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:10191:x1871272549048320:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584800.166237:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584800.166266:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1209 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e2b expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584800.166331:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1210 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584800.166343:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584800.166355:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584800.166582:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784584800.166586:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584800.166674:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1210 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584800.166747:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1209 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e2b expref: 7 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584800.166834:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1210 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e2b expref: 6 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584800.166845:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:0.0:1784584800.166848:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584800.166851:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be800, rc 0) 00000100:00100000:0.0:1784584800.166900:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:10191:x1871272549048320:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 694us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584800.166908:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00080000:2.0:1784584800.167373:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584800.180509:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584800.180600:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549048448 00000100:00100000:2.0:1784584800.180609:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549048448 00000100:00100000:2.0:1784584800.180680:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1784584800.180735:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:10192:x1871272549048448:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584800.180757:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584800.181471:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e32 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.181537:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.181550:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.181560:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.181574:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.181580:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.181601:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.186906:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff122c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.186930:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff122c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.186942:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff122c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584800.187341:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784584800.187347:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584800.187432:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff122c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187445:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187451:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187457:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187475:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584800.187480:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187487:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187507:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:2.0:1784584800.187510:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584800.187514:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187519:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff121e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187532:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187537:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187542:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187547:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584800.187549:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187554:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187560:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97c7c58a0600) 00010000:00010000:2.0:1784584800.187562:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584800.187564:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187569:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187620:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e32 expref: 8 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187635:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff122c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e32 expref: 7 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584800.187653:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c7c58a0c00) 00010000:00010000:2.0:1784584800.187655:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784584800.187658:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2000, rc 0) 00000100:00100000:2.0:1784584800.189257:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:10192:x1871272549048448:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 8559us (8748us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584800.189270:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1784584800.196951:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584800.197214:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549048704 00000100:00100000:3.0:1784584800.197227:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549048704 00000100:00100000:3.0:1784584800.197489:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1784584800.197502:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:10192:x1871272549048704:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584800.197528:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584800.197553:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1233 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e39 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.197638:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.197655:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.197668:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.200194:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.200218:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.200231:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201139:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff1248 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201160:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff1248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201169:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff1248 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584800.201183:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1784584800.201508:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201517:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201524:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201530:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaede00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584800.201534:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201619:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201633:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c7c58a0c00) 00010000:00010000:3.0:1784584800.201636:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584800.201641:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201647:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff123a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201660:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201673:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201679:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201684:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584800.201688:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201741:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201751:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97c7e189cf00) 00010000:00010000:3.0:1784584800.201754:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584800.201757:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.201763:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1241 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.202556:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1233 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e39 expref: 10 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.202579:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff1248 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e39 expref: 9 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584800.202591:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:3.0:1784584800.202594:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584800.202605:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed400, rc 0) 00000100:00100000:3.0:1784584800.202734:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:10192:x1871272549048704:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 5193us (5754us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784584800.202743:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1784584800.212870:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584800.213226:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549048832 00000100:00100000:2.0:1784584800.213236:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549048832 00000100:00100000:2.0:1784584800.213341:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1784584800.213351:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:10192:x1871272549048832:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784584800.213460:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:10192:x1871272549048832:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 110us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584800.213478:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1784584800.284173:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569004416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584800.284244:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584800.284376:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569004416 00000100:00100000:0.0:1784584800.284383:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569004416 00000100:00100000:0.0:1784584800.284447:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784584800.284457:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569004416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1784584800.284505:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584800.284561:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569004416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584800.284567:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1784584800.284662:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7d8aac700 x1871272569004416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584816 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584800.284682:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569004416:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784584800.285536:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584800.285544:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569004928:0@lo:400:kworker.0 00000100:00100000:3.0:1784584800.285592:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584800.285644:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784584800.285652:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569004544:0@lo:400:kworker.0 00000100:00100000:3.0:1784584800.285679:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584800.285713:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569005056:0@lo:400:kworker.0 00000100:00100000:3.0:1784584800.285796:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584800.285974:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569004672:0@lo:400:kworker.0 00000100:00100000:1.0:1784584800.286003:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584800.286031:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584800.286038:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569004800:0@lo:400:kworker.0 00000100:00100000:1.0:1784584800.286059:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584800.286084:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569004544 00000100:00100000:1.0:1784584800.286090:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569004544 00000100:00100000:1.0:1784584800.286127:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784584800.286135:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272569004544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584800.286174:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272569004544:12345-0@lo:400:kworker.0 Request processed in 40us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584800.286181:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784584800.286233:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569005056 00000100:00100000:1.0:1784584800.286237:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569005056 00000100:00100000:1.0:1784584800.286265:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569004672 00000100:00100000:1.0:1784584800.286267:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569004672 00000100:00100000:1.0:1784584800.286279:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569004800 00000100:00100000:1.0:1784584800.286281:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569004800 00000100:00100000:1.0:1784584800.286296:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784584800.286301:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272569005056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584800.286333:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272569005056:12345-0@lo:400:kworker.0 Request processed in 32us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584800.286360:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784584800.286373:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784584800.286378:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569004672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584800.286410:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569004672:12345-0@lo:400:kworker.0 Request processed in 32us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584800.286416:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784584800.286428:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784584800.286434:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569004800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584800.286459:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569004800:12345-0@lo:400:kworker.0 Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584800.286480:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784584800.286515:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569004800:0@lo:400:kworker.0 00000100:00100000:1.0:1784584800.286526:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569004672:0@lo:400:kworker.0 00000100:00100000:1.0:1784584800.286553:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569004544:0@lo:400:kworker.0 00000100:00100000:1.0:1784584800.286562:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569005056:0@lo:400:kworker.0 00000100:00100000:2.0:1784584800.286824:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569004928 00000100:00100000:2.0:1784584800.286829:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569004928 00000100:00100000:2.0:1784584800.286870:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784584800.286878:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569004928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584800.286928:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569004928:12345-0@lo:400:kworker.0 Request processed in 52us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584800.286935:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1784584800.286953:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584800.286956:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584800.286976:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569004928:0@lo:400:kworker.0 00010000:00010000:1.0:1784584800.539814:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584800.928304:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784584801.223465:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584801.224177:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584801.224230:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549049088 00000100:00100000:3.0:1784584801.224239:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549049088 00000100:00100000:3.0:1784584801.224297:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:3.0:1784584801.224350:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2354:x1871272549049088:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584801.224428:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2354:x1871272549049088:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 122us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584801.224436:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:0.0:1784584801.225191:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549048960 00000100:00100000:0.0:1784584801.225199:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549048960 00000100:00100000:1.0:1784584801.225478:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 278 00000100:00100000:1.0:1784584801.225487:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549048960:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584801.225548:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549048960:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 62us (2100us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584801.225565:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 278 00000100:00100000:1.0:1784584801.227484:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584801.227565:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549049216 00000100:00100000:3.0:1784584801.227574:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549049216 00000100:00100000:3.0:1784584801.227651:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:3.0:1784584801.227660:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549049216:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:0.0:1784584801.227672:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584801.227767:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549049216:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 108us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584801.227776:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000001:00080000:2.0:1784584801.335928:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:3.0:1784584801.566058:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584801.925406:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584801.925500:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549049344 00000100:00100000:1.0:1784584801.925510:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549049344 00000100:00100000:1.0:1784584801.925573:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:1.0:1784584801.925584:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:10234:x1871272549049344:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584801.925606:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584801.925629:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e40 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.925714:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.925730:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.925743:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.925758:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.925765:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.925772:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926032:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926049:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926056:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926063:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584801.926067:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926074:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926085:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:1.0:1784584801.926088:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584801.926092:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926097:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff125d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926109:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926115:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926120:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926125:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584801.926272:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926279:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926287:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97c7d6b88e00) 00010000:00010000:1.0:1784584801.926290:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584801.926293:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926299:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1264 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926331:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1256 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e40 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926341:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:1.0:1784584801.926343:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584801.926346:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e40 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584801.926354:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818800, rc 0) 00000100:00100000:1.0:1784584801.926420:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:10234:x1871272549049344:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 838us (1023us total) trans 0 rc 301/301 00000100:00100000:1.0:1784584801.926427:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1784584801.936938:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584801.937309:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549049600 00000100:00100000:0.0:1784584801.937319:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549049600 00000100:00100000:0.0:1784584801.937386:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1784584801.937397:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:10234:x1871272549049600:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:0.0:1784584801.937459:0:6997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584801.937485:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1210 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e2b expref: 8 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.937501:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:0.0:1784584801.937510:0:6997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584801.937776:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.937788:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.937797:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.937809:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.937816:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.937822:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584801.942948:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784584801.942968:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.942981:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.942996:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.943003:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bfe00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584801.943008:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.943016:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.943032:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:0.0:1784584801.943035:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584801.943039:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584801.943046:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff126b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784584801.943064:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004c5cfd70 reply state 000000008475e1a1 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584801.943073:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784584801.956620:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:10234:x1871272549049600:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 19213us (19675us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1784584801.956634:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00010000:00010000:2.0:1784584801.959662:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584801.959680:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584801.959688:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584801.959708:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584801.959714:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584801.959721:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584801.959737:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97c7c636fe00) 00010000:00010000:2.0:1784584801.959741:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584801.959745:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584801.959751:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1272 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584802.103801:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.104820:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549049728 00000100:00100000:1.0:1784584802.104832:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549049728 00000100:00100000:1.0:1784584802.105198:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1784584802.105210:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:10242:x1871272549049728:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:1.0:1784584802.105249:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584802.105273:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1279 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e47 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.105336:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1280 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.105349:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.105360:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584802.105420:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784584802.105425:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584802.105476:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1280 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.105500:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1279 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e47 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.105518:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1280 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e47 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.105538:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:1.0:1784584802.105541:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584802.105545:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818600, rc 0) 00000100:00100000:1.0:1784584802.105838:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:10242:x1871272549049728:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 629us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584802.105846:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00080000:0.0:1784584802.107521:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584802.175792:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.175882:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549049856 00000100:00100000:1.0:1784584802.175891:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549049856 00000100:00100000:1.0:1784584802.175956:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1784584802.175966:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:10248:x1871272549049856:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1784584802.176223:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584802.176244:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1287 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e4e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176306:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176320:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176332:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176348:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176354:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176360:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176473:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819e00/0x787d778cc3ff129c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176481:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819e00/0x787d778cc3ff129c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176506:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819e00/0x787d778cc3ff129c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584802.176539:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1784584802.176542:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584802.176580:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819e00/0x787d778cc3ff129c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176593:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176599:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176605:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176611:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584802.176615:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176623:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176633:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:1.0:1784584802.176636:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584802.176640:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176646:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff128e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176667:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176672:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176678:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176682:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584802.176684:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176884:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176896:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff97c7d6b88a00) 00010000:00010000:1.0:1784584802.176898:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584802.176901:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.176964:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1295 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.177051:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1287 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e4e expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.177065:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819e00/0x787d778cc3ff129c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e4e expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.177082:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:1.0:1784584802.177084:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784584802.177086:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819e00, rc 0) 00000100:00100000:1.0:1784584802.177197:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:10248:x1871272549049856:12345-192.168.203.52@tcp:101:bash.0 Request processed in 1176us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584802.177204:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1784584802.180477:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.180684:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549050112 00000100:00100000:1.0:1784584802.180704:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549050112 00000100:00100000:1.0:1784584802.180763:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1784584802.180773:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:10248:x1871272549050112:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1784584802.180792:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584802.180811:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff12a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e55 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.181263:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.181278:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.181287:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.181338:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.181346:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.181370:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784584802.182373:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1784584802.182574:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182587:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182597:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182633:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182640:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182646:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182652:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819a00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584802.182656:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182662:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182673:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:1.0:1784584802.182676:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584802.182743:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182750:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584802.182764:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef02bc89 reply state 00000000f250e129 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584802.182773:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784584802.182810:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff12a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e55 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182827:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e55 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.182834:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88100) 00010000:00010000:1.0:1784584802.182836:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784584802.182839:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819600, rc 0) 00000100:00100000:1.0:1784584802.183833:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:10248:x1871272549050112:12345-192.168.203.52@tcp:101:bash.0 Request processed in 3055us (3357us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1784584802.183845:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00010000:00010000:1.0:1784584802.188033:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.188050:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.188058:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.188081:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584802.188086:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.188093:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.188111:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7d6b88500) 00010000:00010000:1.0:1784584802.188114:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584802.188119:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.188126:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff12b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584802.190217:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.190304:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549050240 00000100:00100000:2.0:1784584802.190314:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549050240 00000100:00100000:2.0:1784584802.190389:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1784584802.190399:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1871272549050240:12345-192.168.203.52@tcp:8:bash.0 00010000:00080000:2.0:1784584802.190432:0:6605:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp t0 exp 0000000000000000 cur 297 last 0 00000020:00000080:2.0:1784584802.190474:0:6605:0:(genops.c:1406:class_connect()) connect: client 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2, cookie 0x787d778cc3ff12c6 00002000:00100000:2.0:1784584802.190486:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2/ffff97c7fbe4a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784584802.190508:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784584802.190749:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784584802.190779:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7fbe49800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584802.190852:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2353:x1871272549050240:12345-192.168.203.52@tcp:8:bash.0 Request processed in 453us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584802.190868:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1784584802.193310:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.193441:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549050368 00000100:00100000:2.0:1784584802.193459:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549050368 00000100:00100000:2.0:1784584802.193560:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1784584802.193569:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:0:x1871272549050368:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1784584802.193585:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584802.193605:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e5c expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584802.193647:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584802.193665:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=297s v=(0 0) 00010000:00010000:2.0:1784584802.193681:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584802.193714:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e5c expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.193733:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e5c expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.193746:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3200, rc 0) 00000100:00100000:2.0:1784584802.193799:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:0:x1871272549050368:12345-192.168.203.52@tcp:101:bash.0 Request processed in 230us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584802.193805:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00080000:0.0:1784584802.194881:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584802.197566:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584802.197637:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549050496 00000100:00100000:3.0:1784584802.197645:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549050496 00000100:00100000:3.0:1784584802.197754:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1784584802.197765:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:10248:x1871272549050496:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1784584802.197781:0:8782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584802.197801:0:8782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e63 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.197832:0:8782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e5c expref: 8 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.197842:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584802.197846:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584802.197851:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 8 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.197881:0:8782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e5c expref: 8 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.197922:0:8782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e5c expref: 8 pid: 6608 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584802.197937:0:8782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8782:1871272569005184:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584802.198083:0:8782:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1917e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584802.200379:0:8782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8782:1871272569005184:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584802.200424:0:8782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 8 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.200443:0:8782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec400, rc 0) 00000100:00100000:0.0:1784584802.200512:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:10248:x1871272549050496:12345-192.168.203.52@tcp:101:bash.0 Request processed in 2748us (2952us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584802.200521:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1784584802.203549:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.203634:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549050624 00000100:00100000:2.0:1784584802.203642:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549050624 00010000:00010000:2.0:1784584802.203678:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e5c expref: 8 pid: 6608 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584802.203800:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1784584802.203811:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2355:x1871272549050624:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584802.203826:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584802.203848:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e5c expref: 8 pid: 6608 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.203869:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e5c expref: 8 pid: 6608 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.203891:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bb0b7c9/0x787d778cc3ff12cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e5c expref: 8 pid: 6608 timeout: 397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.204034:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584802.204040:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584802.204049:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 7 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.204060:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 7 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.204100:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 7 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584802.204114:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871272569005312:192.168.203.52@tcp:105: 00000100:00100000:2.0:1784584802.204285:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ff7ba480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584802.208491:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.208554:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549050880 00000100:00100000:1.0:1784584802.208563:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549050880 00000100:00100000:1.0:1784584802.208612:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1784584802.208621:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+12:10248:x1871272549050880:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1784584802.209222:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871272569005312:192.168.203.52@tcp:105: 00010000:00010000:0.0:1784584802.209242:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584802.209631:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:10248:x1871272549050880:12345-192.168.203.52@tcp:35:bash.0 Request processed in 1010us (1146us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1784584802.209639:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1784584802.209742:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549050624:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 5931us (6197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584802.209750:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1784584802.312175:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584802.312547:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549051136 00000100:00100000:0.0:1784584802.312560:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549051136 00000100:00100000:0.0:1784584802.312626:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1784584802.312638:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:10258:x1871272549051136:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584802.312661:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584802.312681:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff12db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e6a expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584802.313057:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784584802.313178:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff12db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e6a expref: 15 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.313192:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:0.0:1784584802.313208:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584802.313214:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff12db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e6a expref: 15 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.313689:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bee00, rc 0) 00000100:00100000:0.0:1784584802.314309:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:10258:x1871272549051136:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1669us (2138us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1784584802.314319:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1784584802.322779:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.323475:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549051392 00000100:00100000:1.0:1784584802.323485:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549051392 00000100:00100000:1.0:1784584802.323561:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1784584802.323572:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:10258:x1871272549051392:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584802.323874:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:10258:x1871272549051392:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 303us (1103us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1784584802.324222:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1784584802.332283:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569005440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584802.332354:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584802.332523:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569005440 00000100:00100000:3.0:1784584802.332531:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569005440 00000100:00100000:3.0:1784584802.332599:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784584802.332607:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569005440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584802.332644:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584802.332706:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569005440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584802.332724:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1784584802.332986:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584802.333022:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569005440:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1784584802.399618:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000100:00100000:1.0:1784584802.429542:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584802.429658:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549051520 00000100:00100000:3.0:1784584802.429668:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549051520 00000100:00100000:3.0:1784584802.429760:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1784584802.429771:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:10264:x1871272549051520:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584802.429807:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584802.429829:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff12e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e71 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.429895:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff12f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.430057:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff12f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.430070:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff12f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584802.431001:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1784584802.431009:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584802.431040:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff12f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.431071:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff12e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e71 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.431092:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff12f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e71 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.431114:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:2.0:1784584802.431117:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784584802.431120:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaede00, rc 0) 00000100:00100000:2.0:1784584802.431187:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:10264:x1871272549051520:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1417us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584802.431195:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1784584802.441400:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.441600:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549051776 00000100:00100000:1.0:1784584802.441611:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549051776 00000100:00100000:1.0:1784584802.441669:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1784584802.441679:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:10264:x1871272549051776:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584802.441740:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584802.441761:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff12f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e78 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.441874:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.441889:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.441899:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584802.441920:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784584802.442043:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff12f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e78 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.442060:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e78 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.442069:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88100) 00010000:00010000:1.0:1784584802.442072:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784584802.442089:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819a00, rc 0) 00000100:00100000:1.0:1784584802.442152:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:10264:x1871272549051776:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 474us (760us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1784584802.442159:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:0.0:1784584802.451035:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.451118:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549051904 00000100:00100000:1.0:1784584802.451128:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549051904 00000100:00100000:1.0:1784584802.451189:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1784584802.451199:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:2356:x1871272549051904:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584802.451216:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584802.451241:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff12fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e78 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.451338:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88100) 00010000:00010000:1.0:1784584802.451344:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584802.451480:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:2356:x1871272549051904:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 282us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584802.451489:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1784584802.459102:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.461376:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549052160 00000100:00100000:1.0:1784584802.461391:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549052160 00000100:00100000:1.0:1784584802.461475:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:1.0:1784584802.461485:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:10264:x1871272549052160:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584802.461510:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584802.461532:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff130c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e7f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.461627:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1313 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.461658:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.461669:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1313 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584802.461682:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784584802.462168:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff130c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e7f expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.462187:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e7f expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.462197:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88100) 00010000:00010000:1.0:1784584802.462200:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784584802.462203:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818000, rc 0) 00000100:00100000:1.0:1784584802.462255:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:10264:x1871272549052160:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 772us (3161us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1784584802.463545:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1784584802.469511:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.469605:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549052288 00000100:00100000:2.0:1784584802.469615:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549052288 00000100:00100000:2.0:1784584802.469747:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:2.0:1784584802.469757:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549052288:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:2.0:1784584802.469818:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.469842:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 6 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.469851:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584802.469856:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584802.469861:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.469911:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 6 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.469944:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 6 pid: 8782 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584802.469960:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6608:1871272569005568:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584802.470057:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42000 going to sleep for 11 seconds 00000100:00100000:2.0:1784584802.472942:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6608:1871272569005568:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584802.472973:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584802.474478:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.474925:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549052416 00000100:00100000:2.0:1784584802.474936:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549052416 00002000:00100000:2.0:1784584802.474991:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff97c7c41f1500 x1871272549052416/t0(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:373/0 lens 504/0 e 0 to 0 dl 1784584813 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784584802.475012:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7c41f1500 with x1871272549052416 ext(0->12) 00010000:00010000:2.0:1784584802.475024:0:6611:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 7 pid: 8782 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.475041:0:6611:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 7 pid: 8782 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584802.475049:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97c7c41f1500 00000100:00100000:2.0:1784584802.475078:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1784584802.475088:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549052416:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:2.0:1784584802.478150:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2355:x1871272549052416:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 3052us (3669us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784584802.478166:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:2.0:1784584802.478179:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff97c7c41f1500 x1871272549052416/t4294967299(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:373/0 lens 504/448 e 0 to 0 dl 1784584813 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784584802.478191:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7c41f1500 with x1871272549052416 ext(0->12) 00010000:00010000:2.0:1784584802.478201:0:6611:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 9 pid: 8782 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.478221:0:6611:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 9 pid: 8782 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584802.478230:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97c7c41f1500 00000100:00100000:0.0:1784584802.483318:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.483527:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549052544 00000100:00100000:2.0:1784584802.483537:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549052544 00010000:00010000:2.0:1784584802.483579:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 9 pid: 8782 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584802.483663:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:2.0:1784584802.483674:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2357:x1871272549052544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584802.483688:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784584802.483738:0:5791:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784584802.483742:0:5791:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784584801 00002000:00010000:2.0:1784584802.483745:0:5791:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1784584801 00002000:00010000:2.0:1784584802.483747:0:5791:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784584801 00010000:00010000:2.0:1784584802.483761:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 9 pid: 8782 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.483774:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 9 pid: 8782 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.483795:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff12d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e63 expref: 9 pid: 8782 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.483811:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584802.483815:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584802.483820:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.483830:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.483866:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584802.483933:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2357:x1871272549052544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 260us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584802.483941:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00010000:00010000:3.0:1784584802.484005:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.484014:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.484037:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.484044:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.484051:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.484057:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2600 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584802.484060:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.484079:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.484091:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.484097:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044207730/0x787d778cc3ff1321 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584802.484149:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549052288:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 14394us (14647us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584802.484157:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1784584802.489480:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.489623:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549052800 00000100:00100000:1.0:1784584802.489634:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549052800 00000100:00100000:1.0:1784584802.489736:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1784584802.489747:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:10264:x1871272549052800:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:1.0:1784584802.489808:0:5809:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1313 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e7f expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784584802.490298:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1784584802.490365:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1784584802.491388:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1784584802.491471:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.491489:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e55 expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.491499:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.491535:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e55 expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.491549:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e55 expref: 23 pid: 5808 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584802.491565:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5394a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1871272569005696:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584802.491730:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7f79180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584802.496398:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584802.496798:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549052928 00000100:00100000:0.0:1784584802.496807:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549052928 00010000:00010000:0.0:1784584802.496846:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e55 expref: 24 pid: 5808 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584802.496887:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1784584802.496896:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:2355:x1871272549052928:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584802.496916:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584802.496923:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e55 expref: 24 pid: 5808 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.496935:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e55 expref: 24 pid: 5808 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.496968:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88100) 00010000:00010000:0.0:1784584802.496973:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.496991:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.496998:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.497015:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584802.497064:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:2355:x1871272549052928:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 169us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584802.497071:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00010000:00010000:2.0:1784584802.497963:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff12b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e55 expref: 23 pid: 5808 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584802.497995:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5394a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1871272569005696:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584802.498017:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.498041:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.498048:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784584802.498176:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1784584802.498374:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1784584802.498496:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569005824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784584802.498551:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584802.498587:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c414b900 going to sleep for 11 seconds 00000100:00100000:0.0:1784584802.498837:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569005824 00000100:00100000:0.0:1784584802.498844:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569005824 00000100:00100000:0.0:1784584802.498918:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584802.498928:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1871272569005824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784584802.499015:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1871272569005824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 89us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584802.499023:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584802.499063:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569005824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784584802.499678:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1784584802.499773:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f42c0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569005952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784584802.499806:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584802.499825:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5f91840 going to sleep for 11 seconds 00000100:00100000:0.0:1784584802.499847:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569005952 00000100:00100000:0.0:1784584802.499851:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569005952 00000100:00100000:0.0:1784584802.499873:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584802.499879:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1871272569005952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784584802.500014:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5809:x1871272569005952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 135us (207us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1784584802.500021:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584802.500054:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f42c0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569005952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784584802.500092:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1784584802.500123:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.500133:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.500141:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.500148:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584802.500152:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.500159:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.500174:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88100) 00010000:00010000:0.0:1784584802.500176:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784584802.500181:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584802.500187:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1328 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784584802.500352:0:5809:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784584802.500579:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1784584802.500590:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297607897155ns, next at 298607895317ns, rc = 0 00000001:00080000:0.0:1784584802.500597:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1784584802.500631:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88100) 00010000:00010000:0.0:1784584802.500634:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784584802.500641:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1313 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e7f expref: 27 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584802.500767:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:10264:x1871272549052800:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 11022us (11298us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1784584802.500776:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000020:00080000:0.0:1784584802.500779:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1784584802.501125:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584802.506571:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.506747:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549053056 00000100:00100000:1.0:1784584802.506757:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549053056 00000100:00100000:1.0:1784584802.506819:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:1.0:1784584802.506829:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:10264:x1871272549053056:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584802.506855:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584802.506877:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff132f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e86 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.506950:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff132f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e86 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.506997:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff132f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e86 expref: 27 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584802.507018:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584802.507021:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784584802.507024:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818c00, rc 0) 00000100:00100000:1.0:1784584802.507086:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:10264:x1871272549053056:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 258us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584802.507093:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1784584802.515082:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.515829:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549053312 00000100:00100000:2.0:1784584802.515840:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549053312 00000100:00100000:2.0:1784584802.515887:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1784584802.515906:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f47450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:10264:x1871272549053312:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1784584802.516433:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f47450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:10264:x1871272549053312:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 536us (1359us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1784584802.516441:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00010000:00010000:1.0:1784584802.587886:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584802.602286:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.602615:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549053568 00000100:00100000:2.0:1784584802.602626:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549053568 00000100:00100000:2.0:1784584802.602723:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:2.0:1784584802.602734:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:10274:x1871272549053568:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584802.602765:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584802.602791:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1336 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e8d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584802.602953:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1784584802.603182:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1336 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e8d expref: 30 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.603197:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:2.0:1784584802.603200:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584802.603206:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1336 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e8d expref: 30 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.603219:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3400, rc 0) 00000100:00100000:2.0:1784584802.603350:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:10274:x1871272549053568:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 617us (1072us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1784584802.603358:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1784584802.611977:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.612195:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549053696 00000100:00100000:2.0:1784584802.612210:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549053696 00000100:00100000:2.0:1784584802.612325:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:2.0:1784584802.612338:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:10274:x1871272549053696:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1784584802.612428:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612445:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612469:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612485:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612509:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612516:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612628:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612637:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612644:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584802.612725:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612740:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612746:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612753:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612760:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584802.612765:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612772:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612794:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:2.0:1784584802.612797:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584802.612803:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612808:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1344 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612821:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612827:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612831:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612836:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584802.612838:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612844:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612851:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c58a0d00) 00010000:00010000:2.0:1784584802.612853:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584802.612855:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612861:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff134b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612886:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612892:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612898:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612903:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584802.612906:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612911:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612919:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:2.0:1784584802.612921:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584802.612924:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.612928:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1352 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584802.613144:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:10274:x1871272549053696:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 807us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584802.613153:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:3.0:1784584802.616247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.616307:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549053952 00000100:00100000:2.0:1784584802.616317:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549053952 00000100:00100000:2.0:1784584802.616376:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1784584802.616401:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:10274:x1871272549053952:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1784584802.617137:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+30:10274:x1871272549053952:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 734us (897us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1784584802.617146:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1784584802.683869:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584802.684022:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549054208 00000100:00100000:2.0:1784584802.684031:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549054208 00000100:00100000:2.0:1784584802.684089:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1784584802.684099:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+30:10277:x1871272549054208:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584802.684124:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584802.684147:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1359 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e94 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684220:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684234:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684244:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684257:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684265:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684271:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684410:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684419:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684428:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584802.684438:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1784584802.684551:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684861:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684872:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684879:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584802.684884:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684892:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.684979:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:2.0:1784584802.684982:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584802.684987:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685006:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff1360 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685021:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685027:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685032:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685037:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584802.685041:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685048:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685056:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c58a0d00) 00010000:00010000:2.0:1784584802.685058:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584802.685061:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685067:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685114:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1359 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e94 expref: 33 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685127:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e94 expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584802.685143:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:2.0:1784584802.685145:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584802.685147:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3400, rc 0) 00000100:00100000:2.0:1784584802.685382:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:10277:x1871272549054208:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1282us (1519us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1784584802.685391:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1784584802.699434:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584802.699532:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549054336 00000100:00100000:3.0:1784584802.699543:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549054336 00000100:00100000:3.0:1784584802.699604:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:3.0:1784584802.699614:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:10277:x1871272549054336:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1784584802.699686:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.699745:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.699758:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.699924:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.699933:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.699941:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.699947:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584802.699951:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.699959:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.699971:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584802.699982:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584802.699987:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584802.699993:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff137c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584802.700081:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:10277:x1871272549054336:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 467us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584802.700089:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:3.0:1784584802.702410:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584802.702538:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549054592 00000100:00100000:1.0:1784584802.702547:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549054592 00000100:00100000:1.0:1784584802.702606:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1784584802.702616:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:10277:x1871272549054592:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584802.702869:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+33:10277:x1871272549054592:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 253us (465us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1784584802.702877:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1784584803.093417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584803.094090:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549054848 00000100:00100000:3.0:1784584803.094102:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549054848 00000100:00100000:3.0:1784584803.094219:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1784584803.094230:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+33:10308:x1871272549054848:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1784584803.094256:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584803.094277:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1383 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2e9b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.094379:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff138a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.094393:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff138a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.094406:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff138a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584803.094416:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784584803.094554:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1383 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e9b expref: 36 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.094574:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff138a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e9b expref: 35 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.094582:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584803.094585:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784584803.094588:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed000, rc 0) 00000100:00100000:3.0:1784584803.094647:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:10308:x1871272549054848:12345-192.168.203.52@tcp:101:cat.0 Request processed in 420us (1239us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1784584803.094654:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1784584803.101207:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584803.101318:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584803.101456:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549055232 00000100:00100000:3.0:1784584803.101480:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549055232 00000100:00100000:3.0:1784584803.101543:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1784584803.101552:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:2354:x1871272549055232:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584803.101567:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584803.101592:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff138a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e9b expref: 35 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.101612:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584803.101617:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584803.101666:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:2354:x1871272549055232:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 116us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584803.101673:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:1.0:1784584803.102468:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549055104 00000100:00100000:1.0:1784584803.102475:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549055104 00000100:00100000:1.0:1784584803.102551:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1784584803.102560:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:10308:x1871272549055104:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1784584803.102930:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:10308:x1871272549055104:12345-192.168.203.52@tcp:35:cat.0 Request processed in 370us (1731us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1784584803.102949:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1784584803.188537:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584803.188628:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549055488 00000100:00100000:2.0:1784584803.188637:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549055488 00000100:00100000:2.0:1784584803.188719:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1784584803.188731:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:10314:x1871272549055488:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:2.0:1784584803.188760:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584803.188763:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784584803.189124:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff12f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e71 expref: 35 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.189144:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:2.0:1784584803.189148:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584803.189163:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1398 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ea2 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.189259:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.189274:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e94 expref: 35 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.189301:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.189335:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e94 expref: 35 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.189348:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e94 expref: 35 pid: 5806 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584803.189361:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569006080:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584803.189466:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e02fc180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584803.193683:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569006080:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584803.194288:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584803.196610:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584803.196759:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549055616 00000100:00100000:1.0:1784584803.196768:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549055616 00010000:00010000:1.0:1784584803.196817:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e94 expref: 36 pid: 5806 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584803.196854:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1784584803.196864:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+36:2355:x1871272549055616:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584803.196879:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584803.196886:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e94 expref: 36 pid: 5806 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.196898:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e94 expref: 36 pid: 5806 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.196925:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff136e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e94 expref: 36 pid: 5806 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.196942:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584803.196947:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.196955:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.196985:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.197011:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584803.197061:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:2355:x1871272549055616:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 199us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584803.197069:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00010000:00010000:0.0:1784584803.198340:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.198353:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584803.198375:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784584803.198565:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1398 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea2 expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.198598:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea2 expref: 35 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.198606:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:0.0:1784584803.198609:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784584803.198611:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3000, rc 0) 00000100:00100000:0.0:1784584803.198658:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:10314:x1871272549055488:12345-192.168.203.52@tcp:101:dd.0 Request processed in 9930us (10130us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1784584803.198665:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1784584803.204210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584803.204458:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549055872 00000100:00100000:1.0:1784584803.204469:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549055872 00000100:00100000:1.0:1784584803.204536:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:1.0:1784584803.204547:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:10314:x1871272549055872:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:1.0:1784584803.205373:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.205391:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.205402:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784584803.205464:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1784584803.205489:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000000c22d0 reply state 00000000d750509c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584803.205497:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584803.205662:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:10314:x1871272549055872:12345-192.168.203.52@tcp:36:dd.0 Request processed in 1115us (1529us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1784584803.205671:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000020:00080000:1.0:1784584803.205676:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784584803.211512:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.211529:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.211537:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.211543:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584803.211548:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.211556:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.211573:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:2.0:1784584803.211594:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584803.211599:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584803.211606:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff13ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584803.509287:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584803.509507:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549056000 00000100:00100000:3.0:1784584803.509518:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549056000 00000100:00100000:3.0:1784584803.509625:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:3.0:1784584803.509636:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:10328:x1871272549056000:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:3.0:1784584803.509663:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584803.509683:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff13b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ea9 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.509789:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.509805:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.509816:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.509847:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.509855:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.509862:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.509987:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.509999:0:6997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea2 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.510008:0:6997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.510041:0:6997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea2 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.510054:0:6997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea2 expref: 38 pid: 5807 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584803.510068:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569006208:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584803.510175:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ff7ba9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584803.518326:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584803.518454:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549056256 00000100:00100000:2.0:1784584803.518464:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549056256 00000100:00100000:2.0:1784584803.518611:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1784584803.518624:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+39:5568:x1871272549056256:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784584803.518741:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569006208:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584803.518766:0:6997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584803.519170:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:5568:x1871272549056256:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 548us (851us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1784584803.519180:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1784584803.521653:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584803.521758:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549056384 00000100:00100000:3.0:1784584803.521768:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549056384 00010000:00010000:3.0:1784584803.521823:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea2 expref: 40 pid: 5807 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584803.522159:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1784584803.522171:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:2355:x1871272549056384:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584803.522185:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584803.522192:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea2 expref: 40 pid: 5807 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.522204:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea2 expref: 40 pid: 5807 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.522226:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff139f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea2 expref: 40 pid: 5807 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.522243:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584803.522248:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.522257:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.522265:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.522300:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584803.522360:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+39:2355:x1871272549056384:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 191us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584803.522368:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00010000:00010000:1.0:1784584803.522458:0:6997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522468:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584803.522514:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784584803.522518:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584803.522557:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522573:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522583:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522589:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522596:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522602:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584803.522606:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522614:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522623:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:1.0:1784584803.522626:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584803.522637:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522643:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff13bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522656:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522662:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522668:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522673:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaecc00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584803.522676:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522682:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522735:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7e189cf00) 00010000:00010000:1.0:1784584803.522739:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584803.522743:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522749:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff13c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522789:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff13b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea9 expref: 39 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522815:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea9 expref: 38 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.522823:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584803.522826:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784584803.522828:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaede00, rc 0) 00000100:00100000:1.0:1784584803.522871:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:10328:x1871272549056000:12345-192.168.203.52@tcp:101:stat.0 Request processed in 13223us (13580us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584803.522879:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00010000:00010000:3.0:1784584803.612324:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584803.622421:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584803.622526:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549056640 00000100:00100000:3.0:1784584803.622537:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549056640 00000100:00100000:3.0:1784584803.622598:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1784584803.622609:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:10334:x1871272549056640:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:3.0:1784584803.622664:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584803.622728:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff13c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ea9 expref: 38 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.622746:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584803.622751:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584803.622966:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.622980:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584803.622989:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784584803.623050:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1784584803.623280:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001802b95f reply state 00000000a1428d00 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584803.623289:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784584803.623397:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:10334:x1871272549056640:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 788us (985us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1784584803.623406:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00000020:00080000:3.0:1784584803.623410:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784584803.625969:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.625988:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.625995:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.626001:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584803.626006:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.626319:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.626341:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584803.626344:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584803.626366:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.626374:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff13d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584803.825004:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584803.825829:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549056768 00000100:00100000:0.0:1784584803.825840:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549056768 00000100:00100000:0.0:1784584803.825904:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:0.0:1784584803.825914:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+39:10348:x1871272549056768:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:0.0:1784584803.825939:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584803.825962:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff13d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2eb0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826025:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826039:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826084:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826101:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826108:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826114:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826536:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826546:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826555:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584803.826589:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1784584803.826594:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584803.826684:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826725:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826733:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826749:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826756:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826762:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584803.826767:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826775:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826786:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584803.826789:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584803.826793:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826799:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff13de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826814:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826820:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826826:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826831:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584803.826839:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826846:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826854:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c636f300) 00010000:00010000:0.0:1784584803.826856:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584803.826859:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826865:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff13e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826899:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff13d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb0 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826912:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb0 expref: 40 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584803.826919:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:0.0:1784584803.826921:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584803.826924:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfe00, rc 0) 00000100:00100000:0.0:1784584803.827037:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:10348:x1871272549056768:12345-192.168.203.52@tcp:101:stat.0 Request processed in 1123us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584803.827053:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:2.0:1784584803.929386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584803.929534:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549057024 00000100:00100000:1.0:1784584803.929543:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549057024 00000100:00100000:1.0:1784584803.929597:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1784584803.929606:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:10358:x1871272549057024:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584803.929628:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584803.929647:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff13f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2eb7 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584803.929808:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1784584803.931015:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff13f3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb7 expref: 42 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.931034:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:1.0:1784584803.931037:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784584803.931042:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff13f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb7 expref: 42 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584803.931057:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819c00, rc 0) 00000100:00100000:1.0:1784584803.931374:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+41:10358:x1871272549057024:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1763us (1991us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1784584803.931384:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1784584803.938017:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584803.938164:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549057280 00000100:00100000:0.0:1784584803.938174:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549057280 00000100:00100000:0.0:1784584803.938232:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1784584803.938242:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+41:10358:x1871272549057280:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1784584803.938516:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+42:10358:x1871272549057280:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 274us (507us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1784584803.938525:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1784584804.016820:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.017131:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549057536 00000100:00100000:1.0:1784584804.017141:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549057536 00000100:00100000:1.0:1784584804.017209:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1784584804.017219:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+42:10364:x1871272549057536:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1784584804.017246:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584804.017266:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1401 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ebe expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.017401:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.017417:0:6997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb0 expref: 43 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.017426:0:6997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.017469:0:6997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb0 expref: 43 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.017482:0:6997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb0 expref: 43 pid: 5807 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584804.017495:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569006336:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584804.017596:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7f79600 going to sleep for 11 seconds 00000100:00080000:2.0:1784584804.018545:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584804.022523:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569006336:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584804.022557:0:6997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584804.024491:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.024791:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549057664 00000100:00100000:1.0:1784584804.024800:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549057664 00010000:00010000:1.0:1784584804.024851:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb0 expref: 44 pid: 5807 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584804.024889:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1784584804.024900:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+44:2354:x1871272549057664:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584804.024915:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584804.024922:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb0 expref: 44 pid: 5807 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.024934:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb0 expref: 44 pid: 5807 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.024972:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff13ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eb0 expref: 44 pid: 5807 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.024992:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584804.024997:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.025006:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.025023:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.025057:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584804.025136:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+43:2354:x1871272549057664:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 237us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584804.025145:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00010000:00010000:0.0:1784584804.025623:0:6997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.025633:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584804.025652:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1784584804.025848:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1401 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ebe expref: 44 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.025866:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ebe expref: 43 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.025874:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:0.0:1784584804.025877:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784584804.025880:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819200, rc 0) 00000100:00100000:0.0:1784584804.025918:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+43:10364:x1871272549057536:12345-192.168.203.52@tcp:101:bash.0 Request processed in 8701us (9107us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1784584804.025926:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1784584804.029411:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.030539:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549057920 00000100:00100000:1.0:1784584804.030555:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549057920 00000100:00100000:1.0:1784584804.030681:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1784584804.030708:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+43:10364:x1871272549057920:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:1.0:1784584804.031559:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.031584:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.031599:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784584804.031661:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1784584804.031688:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000052eeb48f reply state 000000003a160d21 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584804.031725:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584804.032028:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+46:10364:x1871272549057920:12345-192.168.203.52@tcp:36:bash.0 Request processed in 1333us (2628us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1784584804.032038:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000020:00080000:1.0:1784584804.032045:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784584804.034265:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584804.034288:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584804.034297:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584804.034305:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819a00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584804.034310:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584804.034319:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584804.034351:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584804.034355:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584804.034360:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584804.034367:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1416 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584804.041532:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584804.041997:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549058048 00000100:00100000:0.0:1784584804.042011:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549058048 00000100:00100000:0.0:1784584804.042089:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1784584804.042101:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:10364:x1871272549058048:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584804.042135:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584804.042182:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff141d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ec5 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.042500:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.042520:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ebe expref: 46 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.042532:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.042577:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ebe expref: 46 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.042592:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ebe expref: 46 pid: 6997 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584804.042608:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f42c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569006464:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584804.042793:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5f91e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584804.051912:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584804.052194:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f42c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569006464:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584804.052230:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584804.052368:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549058176 00000100:00100000:1.0:1784584804.052377:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549058176 00010000:00010000:1.0:1784584804.052423:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ebe expref: 47 pid: 6997 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584804.052473:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:1.0:1784584804.052500:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:2354:x1871272549058176:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584804.052520:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584804.052528:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ebe expref: 47 pid: 6997 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.052542:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ebe expref: 47 pid: 6997 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.052570:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1408 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ebe expref: 47 pid: 6997 timeout: 399 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.052588:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584804.052594:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.052605:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.052613:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.052648:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584804.052761:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+46:2354:x1871272549058176:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 261us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584804.052771:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00010000:00010000:0.0:1784584804.053452:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.053464:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584804.053543:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784584804.053549:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584804.053578:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.053620:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff141d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ec5 expref: 46 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.053642:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ec5 expref: 45 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.053652:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:0.0:1784584804.053656:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584804.053659:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be800, rc 0) 00000100:00100000:0.0:1784584804.053789:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:10364:x1871272549058048:12345-192.168.203.52@tcp:101:bash.0 Request processed in 11690us (12271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584804.053799:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:2.0:1784584804.060638:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.060788:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549058432 00000100:00100000:1.0:1784584804.060802:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549058432 00000100:00100000:1.0:1784584804.060876:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1784584804.060895:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f46050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:10364:x1871272549058432:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:1.0:1784584804.061239:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f46050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+46:10364:x1871272549058432:12345-192.168.203.52@tcp:35:bash.0 Request processed in 351us (614us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1784584804.061248:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1784584804.143231:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.143353:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549058688 00000100:00100000:1.0:1784584804.143366:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549058688 00000100:00100000:1.0:1784584804.143453:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1784584804.143465:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+46:10374:x1871272549058688:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584804.143496:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584804.143524:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff142b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ecc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584804.143685:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1784584804.144071:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff142b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ecc expref: 48 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.144090:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:1.0:1784584804.144094:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784584804.144100:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff142b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ecc expref: 48 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.144119:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819200, rc 0) 00000100:00100000:1.0:1784584804.144251:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:10374:x1871272549058688:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 788us (1032us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1784584804.144260:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1784584804.148095:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.148308:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549058816 00000100:00100000:1.0:1784584804.148321:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549058816 00000100:00100000:1.0:1784584804.148386:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1784584804.148418:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:10374:x1871272549058816:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1784584804.148539:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.148560:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.148574:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.148592:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.148599:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.148606:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.148777:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.148787:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.148794:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584804.148851:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149036:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149051:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149059:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149067:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584804.149072:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149080:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149095:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:1.0:1784584804.149098:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584804.149103:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149110:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1439 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149127:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149133:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149139:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149145:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584804.149157:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149163:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149171:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7d6b88a00) 00010000:00010000:1.0:1784584804.149174:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584804.149177:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149183:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149200:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149207:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149213:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149218:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584804.149221:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149227:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149234:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584804.149236:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584804.149246:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.149253:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584804.149342:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:10374:x1871272549058816:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 925us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584804.149352:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1784584804.152171:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.152259:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549059072 00000100:00100000:1.0:1784584804.152273:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549059072 00000100:00100000:1.0:1784584804.152341:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1784584804.152352:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:10374:x1871272549059072:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584804.152751:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+48:10374:x1871272549059072:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 399us (592us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1784584804.152760:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1784584804.197989:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.198132:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549059328 00000100:00100000:1.0:1784584804.198146:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549059328 00000100:00100000:1.0:1784584804.198262:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1784584804.198276:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+48:10377:x1871272549059328:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584804.198311:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584804.198342:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff144e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ed3 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.198460:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.198486:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.198521:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.198540:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.198549:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.198557:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.198785:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.198796:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.198804:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584804.198816:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784584804.199200:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199208:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199215:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199223:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584804.199235:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199244:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199259:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:1.0:1784584804.199263:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584804.199268:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199275:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199290:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199297:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199303:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199308:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584804.199311:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199317:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199324:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7d6b88a00) 00010000:00010000:1.0:1784584804.199326:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584804.199336:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199341:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff145c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199392:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff144e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ed3 expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199409:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ed3 expref: 50 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.199417:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584804.199419:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784584804.199422:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819200, rc 0) 00000100:00100000:1.0:1784584804.199649:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:10377:x1871272549059328:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1375us (1673us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1784584804.199659:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:3.0:1784584804.203390:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.203575:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549059456 00000100:00100000:1.0:1784584804.203590:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549059456 00000100:00100000:1.0:1784584804.203787:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1784584804.203800:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:10377:x1871272549059456:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1784584804.203897:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.203918:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.203932:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.203993:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.204002:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.204009:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.204017:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584804.204022:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.204030:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.204045:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584804.204048:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784584804.204053:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.204062:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1471 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584804.204150:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:10377:x1871272549059456:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 352us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584804.204158:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:2.0:1784584804.205123:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584804.205344:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549059584 00000100:00100000:3.0:1784584804.205354:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549059584 00000100:00100000:3.0:1784584804.205421:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1784584804.205431:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:2357:x1871272549059584:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584804.205488:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584804.205518:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ed3 expref: 50 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584804.205542:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584804.205547:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584804.205609:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+49:2357:x1871272549059584:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 179us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584804.205616:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1784584804.211290:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.211380:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549059840 00000100:00100000:1.0:1784584804.211394:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549059840 00000100:00100000:1.0:1784584804.211481:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1784584804.211511:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+49:10377:x1871272549059840:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584804.211889:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:10377:x1871272549059840:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 379us (610us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1784584804.211898:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1784584804.373837:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.374016:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549060096 00000100:00100000:1.0:1784584804.374028:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549060096 00000100:00100000:1.0:1784584804.374107:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:1.0:1784584804.374119:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:10395:x1871272549060096:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:1.0:1784584804.374150:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584804.374178:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1478 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2eda expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.374302:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff147f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.374319:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff147f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.374332:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff147f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584804.374346:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784584804.374519:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1478 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eda expref: 53 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.374542:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff147f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eda expref: 52 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.374576:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584804.374580:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784584804.374584:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818000, rc 0) 00000100:00100000:1.0:1784584804.374667:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10395:x1871272549060096:12345-192.168.203.52@tcp:101:cat.0 Request processed in 551us (844us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1784584804.374675:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1784584804.394445:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584804.394576:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549060224 00000100:00100000:0.0:1784584804.394589:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549060224 00000100:00100000:0.0:1784584804.394671:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1784584804.394683:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10396:x1871272549060224:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584804.394752:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584804.394787:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff148d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ee1 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.394905:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1494 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.394959:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.394976:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584804.395132:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1784584804.395140:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584804.395181:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1494 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.395228:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff148d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee1 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.395259:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1494 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee1 expref: 53 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584804.395272:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584804.395278:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584804.395282:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf800, rc 0) 00000100:00100000:0.0:1784584804.395384:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10396:x1871272549060224:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 702us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584804.395392:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:2.0:1784584804.400077:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.400197:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549060608 00000100:00100000:1.0:1784584804.400209:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549060608 00000100:00100000:1.0:1784584804.400271:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1784584804.400281:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10396:x1871272549060608:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584804.400766:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10396:x1871272549060608:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 476us (697us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1784584804.400776:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:3.0:1784584804.403084:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.404169:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549060736 00000100:00100000:1.0:1784584804.404184:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549060736 00000100:00100000:1.0:1784584804.404275:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1784584804.404287:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10396:x1871272549060736:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:1.0:1784584804.404308:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784584804.404340:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1424 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ec5 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.404369:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff147f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eda expref: 53 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.404382:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff132f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e86 expref: 52 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.404412:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584804.404426:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584804.404518:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:10396:x1871272549060736:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 232us (1447us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584804.404526:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1784584804.407523:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.407916:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549060864 00000100:00100000:1.0:1784584804.407930:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549060864 00000100:00100000:1.0:1784584804.407995:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1784584804.408006:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:10396:x1871272549060864:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:1.0:1784584804.408179:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.408198:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.408211:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784584804.409134:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784584804.412777:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1784584804.412901:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1784584804.413080:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:10396:x1871272549060864:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 5065us (5561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584804.413094:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:2.0:1784584804.448925:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584804.449039:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549060992 00000100:00100000:1.0:1784584804.449052:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549060992 00000100:00100000:1.0:1784584804.449191:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:1.0:1784584804.449205:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:10398:x1871272549060992:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584804.449260:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584804.449290:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff14a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ee8 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449378:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449396:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449410:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449426:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449433:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449451:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449579:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449589:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449596:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584804.449639:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1784584804.449649:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584804.449671:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449684:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449740:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449747:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449755:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449762:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584804.449766:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449773:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449786:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:1.0:1784584804.449790:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584804.449794:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449801:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff14a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449814:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449830:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449836:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449841:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584804.449844:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449850:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449857:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7d6b88500) 00010000:00010000:1.0:1784584804.449859:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584804.449862:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449867:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff14b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449900:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff14a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee8 expref: 53 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449915:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee8 expref: 52 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584804.449923:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88a00) 00010000:00010000:1.0:1784584804.449926:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584804.449932:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819000, rc 0) 00000100:00100000:1.0:1784584804.450013:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10398:x1871272549060992:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 811us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584804.450022:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00010000:00010000:1.0:1784584804.635864:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584805.021219:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784584805.021254:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584805.021329:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784584805.021516:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784584805.021686:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569006592:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784584805.021870:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e02fc180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584805.035753:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bed80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569006592:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784584805.045410:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584805.045536:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549061120 00000100:00100000:1.0:1784584805.045549:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549061120 00000100:00100000:1.0:1784584805.045650:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1784584805.045662:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10410:x1871272549061120:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784584805.045805:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10410:x1871272549061120:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 145us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584805.045930:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1784584805.054051:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584805.056524:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549061248 00000100:00100000:0.0:1784584805.056544:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549061248 00000100:00100000:0.0:1784584805.056630:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1784584805.056642:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10410:x1871272549061248:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784584805.056735:0:5806:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784584805.056925:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10410:x1871272549061248:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 283us (2887us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584805.056934:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1784584805.068174:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584805.081798:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549061376 00000100:00100000:2.0:1784584805.081820:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549061376 00000100:00100000:2.0:1784584805.081926:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1784584805.081938:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10410:x1871272549061376:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784584805.082042:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.082065:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.082081:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085141:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085169:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085183:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085226:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085250:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085259:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584805.085305:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784584805.085310:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584805.085389:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085405:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085412:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085420:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085428:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584805.085442:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085451:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085466:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:2.0:1784584805.085470:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584805.085475:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085493:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff14be lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085509:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085516:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085522:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085527:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584805.085530:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085536:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085547:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff97c7c58a0d00) 00010000:00010000:2.0:1784584805.085550:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584805.085552:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085558:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085574:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085581:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085596:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085602:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584805.085605:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085612:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085621:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88a00) 00010000:00010000:2.0:1784584805.085623:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584805.085626:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.085632:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584805.085825:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10410:x1871272549061376:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 3814us (17592us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584805.085836:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1784584805.101236:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.101345:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549061632 00000100:00100000:3.0:1784584805.101362:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549061632 00000100:00100000:3.0:1784584805.101448:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:3.0:1784584805.101461:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10410:x1871272549061632:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584805.101490:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584805.101518:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff14d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2eef expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.101648:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.101667:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.101728:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584805.101754:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1784584805.102134:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.102143:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.102151:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.102156:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584805.102161:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.102169:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.102184:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88a00) 00010000:00010000:3.0:1784584805.102187:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584805.102192:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.102198:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff14da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.102247:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff14d3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eef expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.102271:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:3.0:1784584805.102273:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584805.102277:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff14d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2eef expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.102287:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaede00, rc 0) 00000100:00100000:3.0:1784584805.102368:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10410:x1871272549061632:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 910us (1141us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1784584805.102376:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:0.0:1784584805.122098:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584805.122519:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549061760 00000100:00100000:2.0:1784584805.122532:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549061760 00000100:00100000:2.0:1784584805.122608:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1784584805.122619:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10410:x1871272549061760:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784584805.122666:0:6997:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784584805.125187:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10410:x1871272549061760:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 2553us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584805.125211:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1784584805.138302:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584805.138409:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549062016 00000100:00100000:2.0:1784584805.138422:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549062016 00000100:00100000:2.0:1784584805.138506:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1784584805.138519:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10410:x1871272549062016:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584805.138551:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584805.138555:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784584805.138592:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1494 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee1 expref: 53 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.138615:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:2.0:1784584805.138620:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584805.138639:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ef6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784584805.139231:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1784584805.139496:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.139512:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.139524:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.139595:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff14e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ef6 expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.139635:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ef6 expref: 54 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.139645:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:2.0:1784584805.139648:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584805.139651:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2400, rc 0) 00000100:00100000:2.0:1784584805.139775:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10410:x1871272549062016:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1258us (1487us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1784584805.139785:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1784584805.150345:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584805.150505:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549062272 00000100:00100000:0.0:1784584805.150519:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549062272 00000100:00100000:0.0:1784584805.150593:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:0.0:1784584805.150606:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10410:x1871272549062272:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784584805.150683:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584805.150749:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff14ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ef6 expref: 54 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150772:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:0.0:1784584805.150786:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584805.150815:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150831:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150842:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150859:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150866:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150881:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150975:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150982:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150990:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.150996:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584805.151002:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151011:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151022:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584805.151025:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584805.151029:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151035:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff14fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151044:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151050:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151062:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151068:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584805.151071:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151077:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151085:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xbbae4178 (ffff97c7c636f300) 00010000:00010000:0.0:1784584805.151088:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584805.151090:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.151096:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1504 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xbbae4178 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584805.151341:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10410:x1871272549062272:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 734us (1007us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784584805.151349:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:0.0:1784584805.155502:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584805.155594:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549062400 00000100:00100000:1.0:1784584805.155607:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549062400 00000100:00100000:1.0:1784584805.155677:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1784584805.155689:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10410:x1871272549062400:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584805.155746:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584805.155777:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff150b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2efd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.155826:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.155844:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.155858:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.156000:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff150b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2efd expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.156020:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2efd expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.156030:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584805.156034:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784584805.156037:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818c00, rc 0) 00000100:00100000:1.0:1784584805.156117:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10410:x1871272549062400:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 430us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584805.156139:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1784584805.160860:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584805.160992:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549062656 00000100:00100000:0.0:1784584805.161005:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549062656 00000100:00100000:0.0:1784584805.161087:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:0.0:1784584805.161098:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10410:x1871272549062656:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784584805.161336:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.161373:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.161386:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784584805.166014:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1784584805.166044:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 300273351120ns, next at 301273344981ns, rc = 0 00000004:00010000:1.0:1784584805.166214:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000843d3408 reply state 000000003910f13e transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584805.166230:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584805.166445:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:10410:x1871272549062656:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 5329us (5579us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1784584805.166455:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00010000:00010000:1.0:1784584805.178422:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.178450:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.178473:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.178481:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584805.178487:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.178496:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.178517:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:1.0:1784584805.178520:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784584805.178526:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.178532:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1519 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584805.181608:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.181815:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549062784 00000100:00100000:3.0:1784584805.181829:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549062784 00000100:00100000:3.0:1784584805.182158:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:3.0:1784584805.182172:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10410:x1871272549062784:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584805.182205:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584805.182233:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f04 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.182317:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f04 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.182334:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f04 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.182356:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584805.182360:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584805.182381:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaede00, rc 0) 00000100:00100000:3.0:1784584805.184662:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:10410:x1871272549062784:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2476us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584805.184678:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:3.0:1784584805.196252:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.196294:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549062912 00000100:00100000:3.0:1784584805.196303:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549062912 00000100:00100000:3.0:1784584805.196342:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:3.0:1784584805.196351:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1871272549062912:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1784584805.196383:0:6605:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp t0 exp 0000000000000000 cur 300 last 0 00000020:00000080:3.0:1784584805.196416:0:6605:0:(genops.c:1406:class_connect()) connect: client 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2, cookie 0x787d778cc3ff1527 00002000:00100000:3.0:1784584805.196427:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2/ffff97c7d8a4d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1784584805.196462:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1784584805.196768:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1784584805.196804:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7d8a4b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584805.197790:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2353:x1871272549062912:12345-192.168.203.52@tcp:8:lhsmtool_posix.0 Request processed in 1434us (1543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584805.197801:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1784584805.203601:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584805.204894:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549063040 00000100:00100000:1.0:1784584805.204912:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549063040 00000100:00100000:1.0:1784584805.205387:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1784584805.205401:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:0:x1871272549063040:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1784584805.206760:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1784584805.277599:0:11866:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584805.277607:0:11866:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584805.277750:0:11866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784584805.277758:0:11866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1784584805.284759:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1784584805.284783:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000100:00100000:1.0:1784584805.285367:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:0:x1871272549063040:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 79958us (81771us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1784584805.285380:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1784584805.290361:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584805.292083:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549063296 00000100:00100000:2.0:1784584805.292104:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549063296 00000100:00100000:2.0:1784584805.292199:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1784584805.292213:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:10410:x1871272549063296:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784584805.292551:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:10410:x1871272549063296:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 340us (2199us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1784584805.292561:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1784584805.302980:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584805.303216:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549063552 00000100:00100000:0.0:1784584805.303226:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549063552 00000100:00100000:0.0:1784584805.303287:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:0.0:1784584805.303298:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:10410:x1871272549063552:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784584805.303413:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:10410:x1871272549063552:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 116us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584805.303421:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:1.0:1784584805.307213:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.307293:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549063680 00000100:00100000:3.0:1784584805.307302:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549063680 00000100:00100000:3.0:1784584805.307357:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1784584805.307366:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:10410:x1871272549063680:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584805.307386:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584805.307407:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff152e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f0b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.307506:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.307521:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.307532:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584805.307571:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584805.307592:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.307619:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff152e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f0b expref: 59 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.307634:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f0b expref: 58 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.307728:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584805.307731:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784584805.307735:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed600, rc 0) 00000100:00100000:3.0:1784584805.307789:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:10410:x1871272549063680:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 423us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584805.307795:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1784584805.315082:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584805.315183:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549063808 00000100:00100000:1.0:1784584805.315192:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549063808 00000100:00100000:1.0:1784584805.315251:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1784584805.315262:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2356:x1871272549063808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584805.315282:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584805.315307:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f12 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784584805.315336:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e9a64, blocks: 0x1 00010000:00010000:1.0:1784584805.315355:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=300s v=(0 0) 00010000:00010000:1.0:1784584805.315360:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584805.315370:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f12 expref: 6 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.315388:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f12 expref: 6 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.315402:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819c00, rc 0) 00000100:00100000:1.0:1784584805.315474:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549063808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 213us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584805.315482:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1784584805.322861:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584805.325965:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549064064 00000100:00100000:2.0:1784584805.325979:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549064064 00000100:00100000:2.0:1784584805.326041:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:2.0:1784584805.326053:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:10410:x1871272549064064:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784584805.326176:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:10410:x1871272549064064:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 125us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584805.326198:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:1.0:1784584805.336957:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.339198:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549064192 00000100:00100000:3.0:1784584805.339218:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549064192 00000100:00100000:3.0:1784584805.339322:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1784584805.339336:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:10410:x1871272549064192:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584805.339360:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584805.339389:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f19 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.339428:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f12 expref: 7 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.339450:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584805.339456:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584805.339463:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.339532:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f12 expref: 7 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.339549:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f12 expref: 7 pid: 6605 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584805.339565:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff856d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6608:1871272569006720:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584805.339753:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1917b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584805.343600:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff856d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6608:1871272569006720:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584805.343640:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.343664:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed800, rc 0) 00000100:00100000:3.0:1784584805.343781:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584805.343796:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:10410:x1871272549064192:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 4460us (6843us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584805.343807:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:3.0:1784584805.344832:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549064320 00000100:00100000:3.0:1784584805.344847:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549064320 00010000:00010000:3.0:1784584805.346579:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f12 expref: 7 pid: 6605 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584805.346661:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1784584805.346674:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2356:x1871272549064320:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584805.346709:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584805.346741:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f12 expref: 7 pid: 6605 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.346760:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f12 expref: 7 pid: 6605 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.346795:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff153c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f12 expref: 7 pid: 6605 timeout: 400 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.346817:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584805.346822:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584805.346832:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.346845:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.347835:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584805.348422:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff854700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5790:1871272569006848:192.168.203.52@tcp:105: 00000100:00100000:0.0:1784584805.348605:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1917600 going to sleep for 11 seconds 00000100:00100000:0.0:1784584805.360401:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff854700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5790:1871272569006848:192.168.203.52@tcp:105: 00010000:00010000:0.0:1784584805.360441:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584805.360513:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549064320:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 13842us (16740us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584805.360525:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1784584805.361848:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584805.362539:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549064448 00000100:00100000:0.0:1784584805.362549:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549064448 00002000:00100000:0.0:1784584805.362596:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97c7c5c8ad80 x1871272549064448/t0(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:376/0 lens 504/0 e 0 to 0 dl 1784584816 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784584805.362608:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7c5c8ad80 with x1871272549064448 ext(0->8) 00002000:00010000:0.0:1784584805.362613:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7c5c8ad80 00000100:00100000:0.0:1784584805.362645:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1784584805.362655:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549064448:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784584805.363311:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2354:x1871272549064448:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 655us (1468us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784584805.363320:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00002000:00100000:0.0:1784584805.363328:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff97c7c5c8ad80 x1871272549064448/t4294967302(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:376/0 lens 504/448 e 0 to 0 dl 1784584816 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784584805.363336:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7c5c8ad80 with x1871272549064448 ext(0->8) 00002000:00010000:0.0:1784584805.363339:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7c5c8ad80 00000100:00100000:2.0:1784584805.368919:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.369095:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549064576 00000100:00100000:3.0:1784584805.369113:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549064576 00000100:00100000:3.0:1784584805.369266:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:3.0:1784584805.369278:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:10410:x1871272549064576:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1784584805.412576:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569006976:0@lo:400:kworker.0 00000100:00100000:2.0:1784584805.412759:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569007104:0@lo:400:kworker.0 00000100:00100000:2.0:1784584805.412827:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584805.412875:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569007616:0@lo:400:kworker.0 00000100:00100000:2.0:1784584805.412900:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584805.412929:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584805.412935:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569007232:0@lo:400:kworker.0 00000100:00100000:2.0:1784584805.412956:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584805.412987:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569007104 00000100:00100000:2.0:1784584805.412994:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569007104 00000100:00100000:2.0:1784584805.413032:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569007232 00000100:00100000:2.0:1784584805.413036:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569007232 00000100:00100000:2.0:1784584805.413076:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784584805.413085:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569007104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584805.413134:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569007104:12345-0@lo:400:kworker.0 Request processed in 49us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584805.413142:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784584805.413158:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784584805.413165:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569007232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584805.413318:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584805.413348:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272569007488:0@lo:400:kworker.0 00000100:00100000:3.0:1784584805.413372:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584805.413384:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584805.413389:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569007360:0@lo:400:kworker.0 00000100:00100000:3.0:1784584805.413408:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584805.413446:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569007616 00000100:00100000:3.0:1784584805.413450:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569007616 00000100:00100000:3.0:1784584805.413479:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569007360 00000100:00100000:3.0:1784584805.413482:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569007360 00000100:00100000:3.0:1784584805.413506:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784584805.413512:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3322:x1871272569007616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584805.413542:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3322:x1871272569007616:12345-0@lo:400:kworker.0 Request processed in 31us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584805.413549:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784584805.413562:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784584805.413567:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569007360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584805.413605:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569007360:12345-0@lo:400:kworker.0 Request processed in 28us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584805.413611:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784584805.413651:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569007360:0@lo:400:kworker.0 00000100:00100000:2.0:1784584805.414557:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569007232:12345-0@lo:400:kworker.0 Request processed in 44us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584805.414568:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1784584805.414591:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569007488 00000100:00100000:2.0:1784584805.414606:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569007488 00000100:00100000:2.0:1784584805.414673:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784584805.414757:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272569007488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584805.414881:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272569007488:12345-0@lo:400:kworker.0 Request processed in 131us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584805.414888:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:2.0:1784584805.414925:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584805.414944:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584805.414947:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584805.416004:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569007232:0@lo:400:kworker.0 00000100:00100000:2.0:1784584805.416019:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569007104:0@lo:400:kworker.0 00000100:00100000:2.0:1784584805.416049:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569007616:0@lo:400:kworker.0 00000004:00080000:0.0:1784584805.416216:0:7984:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 300523522565ns, next at 301523520165ns, rc = 0 00000100:00100000:1.0:1784584805.416605:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f42c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569007744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584805.416664:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584805.416753:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569006976 00000100:00100000:1.0:1784584805.416760:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569006976 00000100:00100000:1.0:1784584805.416800:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1784584805.416808:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569006976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584805.416864:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569006976:12345-0@lo:400:kworker.0 Request processed in 56us (3545us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584805.416871:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1784584805.416943:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569007744 00000100:00100000:1.0:1784584805.416947:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569007744 00000100:00100000:1.0:1784584805.416975:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784584805.416981:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1871272569007744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584805.417007:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584805.417043:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1871272569007744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584805.417049:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784584805.417089:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f42c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569007744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584805.420017:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272569007488:0@lo:400:kworker.0 00000100:00100000:3.0:1784584805.420045:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569006976:0@lo:400:kworker.0 00000001:00080000:2.0:1784584805.465234:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1784584805.465248:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1784584805.465280:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1784584805.465305:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c7c414bb40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1784584805.465311:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7e02f6600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c7c4269480 00000020:00080000:2.0:1784584805.465314:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7e02f6d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c7c651c000 00000020:00080000:2.0:1784584805.465445:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1784584805.465458:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784584805.465484:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569008000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784584805.465581:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1784584805.465583:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1784584805.465646:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569007872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784584805.465675:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1784584805.465715:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000100:00100000:3.0:1784584805.465743:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569008000 00000100:00100000:3.0:1784584805.465750:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569008000 00000100:00100000:2.0:1784584805.465761:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569007872 00000100:00100000:2.0:1784584805.465766:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569007872 00000100:00100000:3.0:1784584805.465798:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584805.465806:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784584805.465811:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1871272569008000:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784584805.465820:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569007872:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:3.0:1784584805.465841:0:8782:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1784584805.465875:0:8782:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a5e9a61, atime: 0x6a5e9a61, ctime: 0x6a5e9a61, blocks: 0x1 00010000:00010000:3.0:1784584805.465884:0:8782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.465902:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:3.0:1784584805.465907:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584805.465914:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.465931:0:8782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.465942:0:8782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584805.465950:0:6607:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784584805.465958:0:6607:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784584804 00010000:00010000:3.0:1784584805.465965:0:8782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584805.465970:0:6607:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1784584805.465976:0:6607:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784584804 -> 1784584804 00002000:00010000:2.0:1784584805.465981:0:6607:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:3.0:1784584805.465991:0:8782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784584805.466044:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1871272569007872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (366us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784584805.466052:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1784584805.466100:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7ff819c00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1784584805.466106:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569007872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1784584805.466236:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:10410:x1871272549064576:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 96958us (97323us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584805.466244:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:3.0:1784584805.466875:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3321:x1871272569008000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1067us (1311us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784584805.466884:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1784584805.466906:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584805.466913:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.466922:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584805.466927:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.466936:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.466955:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.466963:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff154a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.466983:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584805.466992:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584805.466994:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784584805.467938:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7ff857100/2, rc 0, transno 4294967301 00000100:00100000:2.0:1784584805.467949:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569008000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784584805.473179:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584805.473226:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549064704 00000100:00100000:2.0:1784584805.473237:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549064704 00000100:00100000:2.0:1784584805.473295:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1784584805.473306:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2355:x1871272549064704:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1784584805.553226:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1784584805.553250:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1784584805.553467:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549064704:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 80156us (80287us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584805.553478:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1784584805.562415:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.562625:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549064960 00000100:00100000:3.0:1784584805.562639:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549064960 00000100:00100000:3.0:1784584805.562746:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:3.0:1784584805.562758:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:10410:x1871272549064960:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784584805.562834:0:6997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584805.562873:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f0b expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.562897:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584805.562903:0:6997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584805.562943:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.562960:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.562972:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584805.563381:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001612f178 reply state 000000007450ee48 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584805.563394:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784584805.563543:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:10410:x1871272549064960:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 787us (1142us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1784584805.563552:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00010000:00010000:3.0:1784584805.567110:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.567144:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.567152:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.568349:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584805.568358:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.568369:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.568391:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584805.568395:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584805.568400:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.568408:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1551 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584805.570413:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.570584:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549065088 00000100:00100000:3.0:1784584805.570593:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549065088 00000100:00100000:3.0:1784584805.570655:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1784584805.570666:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549065088:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784584805.570989:0:8782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1784584805.570993:0:8782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784584804 -> 1784584803 00002000:00010000:3.0:1784584805.570995:0:8782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784584801 00002000:00010000:3.0:1784584805.570997:0:8782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784584804 -> 1784584803 00002000:00010000:3.0:1784584805.571010:0:8782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784584805.571071:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549065088:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 407us (681us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784584805.571078:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1784584805.583635:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584805.584668:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549065344 00000100:00100000:1.0:1784584805.584686:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549065344 00000100:00100000:3.0:1784584805.584905:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:3.0:1784584805.584933:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:10410:x1871272549065344:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784584805.585077:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.585092:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2efd expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.585101:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.585134:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2efd expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.585147:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2efd expref: 13 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584805.585159:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff857800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569008128:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584805.585257:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584805.591607:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff857800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569008128:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584805.591640:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584805.592056:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.592202:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549065472 00000100:00100000:3.0:1784584805.592211:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549065472 00010000:00010000:3.0:1784584805.592247:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2efd expref: 14 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584805.592285:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:3.0:1784584805.592295:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:2355:x1871272549065472:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584805.592310:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584805.592317:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2efd expref: 14 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.592327:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2efd expref: 14 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.592348:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2efd expref: 14 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.592363:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584805.592368:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.592378:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.592386:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.592415:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584805.592494:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2355:x1871272549065472:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 200us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584805.592501:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00010000:00010000:0.0:1784584805.593125:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.593141:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.593188:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.593196:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.593205:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.593212:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584805.593218:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.593227:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.593248:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:0.0:1784584805.593251:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784584805.594120:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.594136:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1558 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584805.594353:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+12:10410:x1871272549065344:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 9421us (10724us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784584805.594367:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:0.0:1784584805.599212:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584805.599291:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549065600 00000100:00100000:1.0:1784584805.599300:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549065600 00000100:00100000:1.0:1784584805.599352:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1784584805.599360:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549065600:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784584805.599401:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.599452:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.599461:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584805.599465:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584805.599469:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.599504:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.599519:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 7 pid: 6608 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584805.599534:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6605:1871272569008256:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584805.599620:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584805.605367:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c88380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6605:1871272569008256:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584805.605410:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584805.606548:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584805.609380:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549065728 00000100:00100000:2.0:1784584805.609440:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549065728 00010000:00010000:2.0:1784584805.609513:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 8 pid: 6608 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584805.609582:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1784584805.609594:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2354:x1871272549065728:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584805.609617:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584805.609648:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 8 pid: 6608 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.609665:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 8 pid: 6608 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.609754:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d0ca733/0x787d778cc3ff1543 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f19 expref: 8 pid: 6608 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.609778:0:8317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584805.609783:0:8317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584805.609790:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.609801:0:8317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584805.609835:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584805.609914:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549065728:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 323us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584805.609934:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00010000:00010000:1.0:1784584805.610215:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.610227:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.610261:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.610285:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.610294:0:6605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.610302:0:6605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584805.610308:0:6605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.610319:0:6605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.610334:0:6605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.610343:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff155f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584805.610422:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549065600:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 11061us (11218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584805.610442:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:0.0:1784584805.616507:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584805.617358:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549065984 00000100:00100000:1.0:1784584805.617378:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549065984 00000100:00100000:1.0:1784584805.617492:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:1.0:1784584805.617525:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+12:10410:x1871272549065984:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784584805.617649:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.617670:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.617685:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.619506:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.619537:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f04 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.619546:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.619597:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f04 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.619617:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f04 expref: 13 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584805.619635:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569008384:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584805.619787:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb840 going to sleep for 11 seconds 00000100:00100000:1.0:1784584805.629290:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569008384:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584805.629332:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584805.629420:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.629518:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549066112 00000100:00100000:3.0:1784584805.629534:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549066112 00010000:00010000:3.0:1784584805.629581:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f04 expref: 14 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584805.629630:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:3.0:1784584805.629641:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:2354:x1871272549066112:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584805.629658:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584805.629666:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f04 expref: 14 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.629680:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f04 expref: 14 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.629751:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1520 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f04 expref: 14 pid: 5806 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.629769:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:3.0:1784584805.629774:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.629782:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.629790:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.629836:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584805.629880:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.629893:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584805.629899:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2354:x1871272549066112:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 255us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584805.629924:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000001:00080000:1.0:1784584805.630403:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1784584805.630609:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1784584805.630660:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1784584805.630813:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5807:1871272569008512:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784584805.630883:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584805.630921:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1784584805.630989:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569008512 00000100:00100000:0.0:1784584805.631001:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569008512 00000100:00100000:0.0:1784584805.631051:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584805.631060:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1871272569008512:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1784584805.631325:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1871272569008512:12345-0@lo:1000:mdt00_001.0 Request processed in 265us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584805.631332:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784584805.631413:0:5807:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1784584805.631422:0:5807:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7ff819c00, transno 4294967303 00000100:00100000:1.0:1784584805.631454:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5807:1871272569008512:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1784584805.633604:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1784584805.633741:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5807:1871272569008640:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1784584805.633822:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584805.633862:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1917000 going to sleep for 11 seconds 00000100:00100000:3.0:1784584805.635333:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569008640 00000100:00100000:3.0:1784584805.635349:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569008640 00000100:00100000:3.0:1784584805.635411:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584805.635422:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1871272569008640:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1784584805.635757:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1871272569008640:12345-0@lo:1000:mdt00_001.0 Request processed in 336us (1934us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1784584805.635767:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584805.635854:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5807:1871272569008640:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1784584805.635918:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.635932:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.635952:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.635960:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584805.635965:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.635973:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636014:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88500) 00010000:00010000:0.0:1784584805.636018:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584805.636024:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636031:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff156d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636096:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636104:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636109:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636115:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584805.636119:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636125:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636134:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88a00) 00010000:00010000:0.0:1784584805.636136:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584805.636139:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636145:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff149b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636230:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636248:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee8 expref: 16 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636259:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636303:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee8 expref: 16 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.636320:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee8 expref: 16 pid: 6997 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584805.636337:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f42c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569008768:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584805.636452:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010da540 going to sleep for 11 seconds 00000100:00100000:2.0:1784584805.645129:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584805.645278:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549066240 00000100:00100000:3.0:1784584805.645288:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549066240 00010000:00010000:3.0:1784584805.645330:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee8 expref: 17 pid: 6997 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584805.645380:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1784584805.645390:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:2354:x1871272549066240:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584805.645405:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584805.645413:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee8 expref: 17 pid: 6997 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.645425:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee8 expref: 17 pid: 6997 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.645458:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88a00) 00010000:00010000:3.0:1784584805.645474:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.645485:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.645497:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584805.645517:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584805.645574:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:2354:x1871272549066240:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 185us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584805.645582:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00010000:00010000:0.0:1784584805.648443:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff14b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ee8 expref: 16 pid: 6997 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584805.648477:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f42c1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569008768:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584805.648509:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648521:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648528:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648570:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648577:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648584:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648591:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584805.648596:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648604:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648625:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88a00) 00010000:00010000:0.0:1784584805.648629:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584805.648634:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648641:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1574 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648651:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648658:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648665:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648677:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584805.648680:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648686:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648732:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88a00) 00010000:00010000:0.0:1784584805.648734:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784584805.648737:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.648743:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1566 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584805.649214:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:10410:x1871272549065984:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 31688us (32712us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1784584805.649230:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000020:00080000:0.0:1784584805.649238:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784584805.649266:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784584805.649277:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784584805.649311:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784584805.649320:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784584805.653314:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584805.653413:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549066496 00000100:00100000:1.0:1784584805.653422:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549066496 00000100:00100000:1.0:1784584805.653533:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:1.0:1784584805.653544:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:10410:x1871272549066496:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784584805.655409:0:5810:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784584805.655544:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1784584805.655620:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.655651:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.655662:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.655672:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.655679:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.655686:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584805.660098:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784584805.660301:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:10410:x1871272549066496:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 6754us (6990us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1784584805.660312:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000020:00080000:1.0:1784584805.660319:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784584805.661168:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584805.661187:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.661202:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584805.661208:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.661221:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.661274:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff97c7d6b88700) 00010000:00010000:0.0:1784584805.661278:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784584805.661284:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.661291:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff157b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584805.661321:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584805.661323:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584805.661325:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584805.661985:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584806.339888:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584806.339928:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584806.339968:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584806.340000:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584806.340022:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584806.340142:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549067008 00000100:00100000:3.0:1784584806.340151:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549067008 00000100:00100000:3.0:1784584806.340211:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549066880 00000100:00100000:3.0:1784584806.340214:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549066880 00000100:00100000:3.0:1784584806.340234:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1784584806.340244:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549067008:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584806.340312:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549067008:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584806.340321:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1784584806.340337:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:3.0:1784584806.340344:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549066880:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584806.340398:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549066880:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 54us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584806.340404:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1784584806.340577:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549066624 00000100:00100000:0.0:1784584806.340582:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549066624 00000100:00100000:0.0:1784584806.340621:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 280 00000100:00100000:0.0:1784584806.340629:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549066624:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584806.340659:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549066624:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584806.340666:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 280 00000100:00100000:0.0:1784584806.340727:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549066752 00000100:00100000:0.0:1784584806.340731:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549066752 00000100:00100000:0.0:1784584806.340756:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549067136 00000100:00100000:0.0:1784584806.340759:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549067136 00000100:00100000:0.0:1784584806.340780:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1784584806.340787:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:2355:x1871272549066752:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584806.340819:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:2355:x1871272549066752:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584806.340835:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:0.0:1784584806.340847:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:0.0:1784584806.340853:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549067136:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584806.340891:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2355:x1871272549067136:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584806.340897:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00080000:2.0:1784584806.341059:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584806.341064:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784584806.685081:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784584807.187335:0:11917:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584807.187343:0:11917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584807.187379:0:11917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784584807.187385:0:11917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784584807.350363:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584807.350450:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549067392 00000100:00100000:3.0:1784584807.350461:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549067392 00000100:00100000:3.0:1784584807.350530:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:3.0:1784584807.350541:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:10428:x1871272549067392:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584807.350562:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584807.350587:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1582 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f20 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.350885:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1589 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.350899:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.350924:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1589 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584807.350936:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1784584807.351111:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1582 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f20 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.351128:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1589 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f20 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.351136:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:3.0:1784584807.351145:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784584807.351149:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaede00, rc 0) 00000100:00100000:3.0:1784584807.351209:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:10428:x1871272549067392:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 670us (854us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1784584807.351216:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:1.0:1784584807.362632:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584807.362677:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549067520 00000100:00100000:1.0:1784584807.362686:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549067520 00000100:00100000:1.0:1784584807.362757:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:1.0:1784584807.362768:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:10428:x1871272549067520:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1784584807.362848:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.362866:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.362885:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.362902:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.362910:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.362916:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363449:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363460:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363468:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584807.363510:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363521:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363527:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363533:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363548:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819a00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584807.363553:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363560:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363572:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:1.0:1784584807.363575:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584807.363579:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363585:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1597 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363596:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363601:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363606:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363611:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584807.363619:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363624:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363641:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7d6b88d00) 00010000:00010000:1.0:1784584807.363643:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584807.363646:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363652:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff159e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363666:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363671:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363676:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363680:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584807.363683:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363688:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363722:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584807.363724:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584807.363727:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.363733:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff15a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584807.363826:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:10428:x1871272549067520:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1058us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584807.363835:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:3.0:1784584807.429820:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584807.429894:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549067776 00000100:00100000:0.0:1784584807.429904:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549067776 00000100:00100000:0.0:1784584807.430021:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:0.0:1784584807.430032:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:10431:x1871272549067776:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584807.430055:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584807.430075:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff15ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f27 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.430228:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.430244:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.430256:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.430291:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.430299:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.430305:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.430644:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.430653:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.430660:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584807.430669:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1784584807.431041:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431050:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431055:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431062:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584807.431066:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431085:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431097:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584807.431100:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584807.431105:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431111:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431122:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431128:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431133:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431138:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bee00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584807.431141:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431146:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431153:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c636f300) 00010000:00010000:0.0:1784584807.431156:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584807.431158:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431174:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff15ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431219:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff15ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f27 expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431233:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f27 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.431240:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:0.0:1784584807.431243:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584807.431245:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be800, rc 0) 00000100:00100000:0.0:1784584807.434680:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:10431:x1871272549067776:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 4638us (4868us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1784584807.434706:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:1.0:1784584807.442966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584807.443091:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549067904 00000100:00100000:3.0:1784584807.443102:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549067904 00000100:00100000:3.0:1784584807.443166:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:3.0:1784584807.443175:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:10431:x1871272549067904:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1784584807.443237:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.443254:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.443266:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.443305:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.443312:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.443319:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.443330:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584807.443334:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.443355:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.443367:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:3.0:1784584807.443370:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584807.443375:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.443382:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff15cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584807.443468:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:10431:x1871272549067904:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 293us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584807.443476:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:1.0:1784584807.448192:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584807.448305:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549068160 00000100:00100000:2.0:1784584807.448316:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549068160 00000100:00100000:2.0:1784584807.448384:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1784584807.448394:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f46450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:10431:x1871272549068160:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1784584807.448641:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f46450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:10431:x1871272549068160:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 247us (457us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1784584807.448649:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1784584807.452051:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584807.452079:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569008896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584807.452158:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584807.452238:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569008896 00000100:00100000:1.0:1784584807.452247:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569008896 00000100:00100000:1.0:1784584807.452312:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784584807.452323:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569008896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784584807.452366:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1784584807.452452:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584807.456102:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569008896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3771us (3935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584807.456117:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784584807.463473:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff857480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569008896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584807.500725:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584807.500856:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549068416 00000100:00100000:2.0:1784584807.500867:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549068416 00000100:00100000:2.0:1784584807.500928:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:2.0:1784584807.500938:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:9952:x1871272549068416:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1784584807.500975:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584807.500998:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff15d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f2e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.501115:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.501130:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f27 expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.501138:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.501173:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f27 expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.501186:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f27 expref: 23 pid: 5806 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584807.501199:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569009024:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584807.501287:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93f00 going to sleep for 11 seconds 00000001:00080000:0.0:1784584807.508239:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1784584807.508252:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000001:00080000:0.0:1784584807.508263:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1784584807.508277:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1784584807.508369:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569009024:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584807.508383:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549068544 00000100:00100000:1.0:1784584807.508391:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549068544 00010000:00010000:2.0:1784584807.508399:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.508443:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f27 expref: 24 pid: 5806 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584807.508492:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1784584807.508503:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:2354:x1871272549068544:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584807.508517:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584807.508524:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f27 expref: 24 pid: 5806 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.508536:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f27 expref: 24 pid: 5806 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.508575:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff15c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f27 expref: 24 pid: 5806 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.508589:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:1.0:1784584807.508594:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.508602:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.508610:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.508638:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584807.508689:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff857480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:2354:x1871272549068544:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 187us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584807.508731:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00010000:00010000:2.0:1784584807.508992:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.509001:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584807.509021:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1784584807.509179:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff15d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f2e expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.509197:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f2e expref: 23 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.509206:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:2.0:1784584807.509209:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784584807.509212:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3400, rc 0) 00000100:00100000:2.0:1784584807.509267:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:9952:x1871272549068416:12345-192.168.203.52@tcp:101:bash.0 Request processed in 8330us (8581us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1784584807.509274:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:3.0:1784584807.513963:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584807.514031:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549068800 00000100:00100000:1.0:1784584807.514041:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549068800 00000100:00100000:1.0:1784584807.514101:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:1.0:1784584807.514112:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:9952:x1871272549068800:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:1.0:1784584807.514386:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.514404:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.514425:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784584807.514489:0:6997:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1784584807.514516:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000659e4c1e reply state 00000000bdc24e2f transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584807.514526:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784584807.514572:0:6997:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1784584807.514831:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:9952:x1871272549068800:12345-192.168.203.52@tcp:36:bash.0 Request processed in 719us (888us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1784584807.514846:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000020:00080000:1.0:1784584807.514852:0:6997:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1784584807.517074:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.517091:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.517098:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.517105:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584807.517110:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.517118:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.517135:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:2.0:1784584807.517138:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584807.517159:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.517166:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff15eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584807.520068:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584807.520234:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549068928 00000100:00100000:0.0:1784584807.520245:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549068928 00000100:00100000:0.0:1784584807.520307:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:0.0:1784584807.520318:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:9952:x1871272549068928:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584807.520358:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584807.520381:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f35 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.520454:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f35 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.520471:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f35 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.520489:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:0.0:1784584807.520651:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584807.520655:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be000, rc 0) 00000100:00100000:0.0:1784584807.520759:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:9952:x1871272549068928:12345-192.168.203.52@tcp:101:bash.0 Request processed in 442us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584807.520766:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:1.0:1784584807.529648:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584807.529737:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549069056 00000100:00100000:3.0:1784584807.529746:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549069056 00000100:00100000:3.0:1784584807.529822:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:3.0:1784584807.529832:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:9952:x1871272549069056:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1784584807.529851:0:8782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584807.529870:0:8782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f3c expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784584807.529896:0:8782:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a5e9a63, atime: 0x6a5e9a61, ctime: 0x6a5e9a63, blocks: 0xb 00010000:00010000:3.0:1784584807.529932:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=302s v=(0 0) 00010000:00010000:3.0:1784584807.529937:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584807.529947:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f3c expref: 7 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.529965:0:8782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f3c expref: 7 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.529978:0:8782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaeca00, rc 0) 00000100:00100000:3.0:1784584807.530039:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:9952:x1871272549069056:12345-192.168.203.52@tcp:101:bash.0 Request processed in 208us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584807.530046:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00080000:0.0:1784584807.533130:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584807.535524:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584807.535624:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549069184 00000100:00100000:2.0:1784584807.535633:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549069184 00002000:00010000:2.0:1784584807.535674:0:6611:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1784584807.535680:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7ff856a00 with x1871272549069184 ext(0->18446744073709551615) 00002000:00010000:2.0:1784584807.535724:0:6611:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7ff856a00. 00000100:00100000:2.0:1784584807.535749:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1784584807.535760:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549069184:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:2.0:1784584807.536032:0:6611:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1784584807.536036:0:6611:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1784584803 -> 1784584807 00002000:00010000:2.0:1784584807.536037:0:6611:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1784584801 -> 1784584801 00002000:00010000:2.0:1784584807.536039:0:6611:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1784584803 -> 1784584807 00002000:00010000:2.0:1784584807.536041:0:6611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1784584807.536143:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff856a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2354:x1871272549069184:12345-192.168.203.52@tcp:10:bash.0 Request processed in 385us (627us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784584807.536150:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00010000:2.0:1784584807.536154:0:6611:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1784584807.536157:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7ff856a00 with x1871272549069184 ext(0->18446744073709551615) 00002000:00010000:2.0:1784584807.536162:0:6611:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7ff856a00. 00000100:00100000:2.0:1784584807.634789:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584807.634900:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549069312 00000100:00100000:1.0:1784584807.634910:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549069312 00000100:00100000:1.0:1784584807.634978:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:1.0:1784584807.634989:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:10445:x1871272549069312:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1784584807.635062:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635078:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635089:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635104:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635111:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635136:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635607:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635618:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635626:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584807.635666:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635678:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635685:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635719:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635726:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584807.635730:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635738:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635750:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:1.0:1784584807.635761:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584807.635766:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635772:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1600 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635784:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635790:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635796:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635801:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584807.635804:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635810:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635817:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584807.635820:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584807.635823:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635829:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1607 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635842:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635854:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635860:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635865:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584807.635869:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635875:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635884:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:1.0:1784584807.635886:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584807.635889:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.635894:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff160e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584807.636261:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:10445:x1871272549069312:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1271us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584807.636271:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:2.0:1784584807.696544:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584807.697817:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549069568 00000100:00100000:0.0:1784584807.697829:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549069568 00000100:00100000:0.0:1784584807.697898:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:0.0:1784584807.697909:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:10448:x1871272549069568:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584807.697929:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584807.697955:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1615 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f43 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698029:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698067:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698077:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698095:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698101:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698107:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698528:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff162a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698538:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff162a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698545:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff162a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584807.698555:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1784584807.698648:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698656:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698663:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698676:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584807.698680:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698688:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698734:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584807.698737:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584807.698742:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698748:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff161c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698760:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698767:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698773:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698779:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584807.698782:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698788:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698807:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c636f500) 00010000:00010000:0.0:1784584807.698810:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584807.698813:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698819:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1623 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698859:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1615 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f43 expref: 30 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698874:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff162a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f43 expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.698881:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:0.0:1784584807.698883:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784584807.698886:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be600, rc 0) 00000100:00100000:0.0:1784584807.698957:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:10448:x1871272549069568:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1049us (2424us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1784584807.698965:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00010000:00010000:0.0:1784584807.708715:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784584807.712349:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784584807.712358:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784584807.712392:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784584807.712398:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784584807.713102:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584807.714116:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549069696 00000100:00100000:2.0:1784584807.714126:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549069696 00000100:00100000:2.0:1784584807.714202:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:2.0:1784584807.714216:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:10448:x1871272549069696:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1784584807.714282:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.714302:0:6997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f2e expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.714312:0:6997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.714346:0:6997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f2e expref: 29 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.714358:0:6997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f2e expref: 29 pid: 5807 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584807.714372:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569009152:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584807.714476:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93540 going to sleep for 11 seconds 00000100:00100000:2.0:1784584807.718843:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584807.718861:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c40f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569009152:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584807.718893:0:6997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584807.719199:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549069952 00000100:00100000:1.0:1784584807.719208:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549069952 00000100:00100000:1.0:1784584807.719267:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:1.0:1784584807.719276:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+30:5568:x1871272549069952:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784584807.719600:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+31:5568:x1871272549069952:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 324us (766us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1784584807.719622:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1784584807.725729:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584807.725817:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549070080 00000100:00100000:3.0:1784584807.725826:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549070080 00010000:00010000:3.0:1784584807.725865:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f2e expref: 31 pid: 5807 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584807.725895:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1784584807.725916:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+31:2354:x1871272549070080:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584807.725930:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584807.725936:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f2e expref: 31 pid: 5807 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.725949:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f2e expref: 31 pid: 5807 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.725970:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff15dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f2e expref: 31 pid: 5807 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.725987:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:3.0:1784584807.725992:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.726001:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.726009:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.726045:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584807.726098:0:6997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584807.726106:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+30:2354:x1871272549070080:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 188us (421us total) trans 0 rc 0/0 00010000:00010000:2.0:1784584807.726115:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584807.726120:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00010000:00010000:2.0:1784584807.726153:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.726161:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.726175:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.726181:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584807.726185:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.726192:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.726202:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:2.0:1784584807.726205:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584807.726208:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.726213:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1638 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584807.726255:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:10448:x1871272549069696:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 12043us (13158us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584807.726263:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:0.0:1784584807.730652:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584807.730890:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549070336 00000100:00100000:1.0:1784584807.730900:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549070336 00000100:00100000:1.0:1784584807.730958:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1784584807.730968:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:10448:x1871272549070336:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584807.731334:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+30:10448:x1871272549070336:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 366us (691us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1784584807.731343:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:0.0:1784584807.849934:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584807.858296:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549070592 00000100:00100000:3.0:1784584807.858311:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549070592 00000100:00100000:3.0:1784584807.858390:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:3.0:1784584807.858400:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+30:10459:x1871272549070592:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:3.0:1784584807.858450:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584807.858474:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff163f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f4a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.858555:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.858569:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.858581:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.858595:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.858603:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.858609:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859122:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859134:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859143:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584807.859153:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1784584807.859258:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859266:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859272:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859279:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaece00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584807.859283:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859290:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859302:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:2.0:1784584807.859305:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584807.859309:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859314:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1646 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859327:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859333:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859338:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859343:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584807.859354:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859360:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.859368:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7e189c800) 00010000:00010000:2.0:1784584807.859371:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584807.859374:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.860538:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff164d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.860625:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff163f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f4a expref: 33 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.860642:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f4a expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.860650:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:2.0:1784584807.860653:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584807.860657:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2600, rc 0) 00000100:00100000:2.0:1784584807.860748:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:10459:x1871272549070592:12345-192.168.203.52@tcp:101:cat.0 Request processed in 2348us (10821us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1784584807.860758:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1784584807.872360:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584807.872475:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549070848 00000100:00100000:1.0:1784584807.872485:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549070848 00000100:00100000:1.0:1784584807.872548:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1784584807.872558:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:10459:x1871272549070848:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1784584807.872875:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+33:10459:x1871272549070848:12345-192.168.203.52@tcp:35:cat.0 Request processed in 318us (524us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1784584807.872883:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1784584807.916388:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584807.916550:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549071104 00000100:00100000:2.0:1784584807.916561:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549071104 00000100:00100000:2.0:1784584807.916620:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:2.0:1784584807.916629:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+33:10460:x1871272549071104:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:2.0:1784584807.916717:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784584807.916748:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff1654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f4a expref: 33 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.916770:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff162a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f43 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.916782:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff15f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f35 expref: 31 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.916792:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c636f900) 00010000:00010000:2.0:1784584807.916802:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584807.916822:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.916836:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.916846:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.916859:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.916868:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.916875:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.917480:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.917491:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.917499:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584807.918437:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1784584807.918448:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303025755719ns, next at 304025753090ns, rc = 0 00010000:00010000:2.0:1784584807.918507:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918518:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918527:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918534:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918540:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918590:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918612:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584807.918632:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918646:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918652:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918659:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584807.918663:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918671:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918683:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584807.918686:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784584807.918717:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918724:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1670 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918741:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918747:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918752:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918756:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584807.918766:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918772:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918780:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:2.0:1784584807.918783:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584807.918786:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.918791:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1662 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584807.918801:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000754cccc5 reply state 000000007b91aff2 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584807.918810:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784584807.919111:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584807.919119:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.919125:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584807.919129:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.919134:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.919160:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:3.0:1784584807.919163:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784584807.919166:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.919172:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1677 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.919187:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584807.919189:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584807.919191:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584807.919292:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:10460:x1871272549071104:12345-192.168.203.52@tcp:36:rm.0 Request processed in 2661us (2909us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1784584807.919301:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00010000:00010000:3.0:1784584807.923287:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.923306:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.923315:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.923323:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584807.923328:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.923338:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.923354:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c58a0800) 00010000:00010000:3.0:1784584807.923358:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584807.923363:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.923386:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1669 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584807.964572:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584807.964667:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549071360 00000100:00100000:0.0:1784584807.964713:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549071360 00000100:00100000:0.0:1784584807.964774:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:0.0:1784584807.964787:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+31:10466:x1871272549071360:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584807.964811:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584807.964830:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff167e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f51 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.965091:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.965170:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.965181:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.965196:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.965202:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.965207:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784584807.966274:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1784584807.966452:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966464:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966485:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966521:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966529:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966535:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966541:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bee00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584807.966558:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966565:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966577:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584807.966580:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584807.966584:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966590:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1685 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784584807.966602:0:5807:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000da3dcc79 reply state 0000000000097525 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584807.966611:0:5807:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784584807.966648:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff167e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f51 expref: 34 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966663:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f51 expref: 33 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.966670:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:0.0:1784584807.966673:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584807.966675:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be400, rc 0) 00000100:00100000:0.0:1784584807.967201:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:10466:x1871272549071360:12345-192.168.203.52@tcp:101:bash.0 Request processed in 2413us (2633us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1784584807.967210:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00010000:00010000:2.0:1784584807.969349:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.969365:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.969372:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.969378:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584807.969382:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.969403:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.969427:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c636f500) 00010000:00010000:2.0:1784584807.969431:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584807.969435:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584807.969441:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff168c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584807.971668:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584807.972242:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549071488 00000100:00100000:0.0:1784584807.972254:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549071488 00000100:00100000:0.0:1784584807.972316:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:0.0:1784584807.972326:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549071488:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584807.972344:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584807.972365:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f58 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784584807.972392:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784584807.972410:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=303s v=(0 0) 00010000:00010000:0.0:1784584807.972427:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584807.972436:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f58 expref: 6 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.972456:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f58 expref: 6 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584807.972485:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf800, rc 0) 00000100:00100000:0.0:1784584807.972561:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549071488:12345-192.168.203.52@tcp:101:bash.0 Request processed in 236us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584807.972568:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:0.0:1784584807.977887:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584807.977968:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549071616 00000100:00100000:3.0:1784584807.977979:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549071616 00000100:00100000:3.0:1784584807.978034:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:3.0:1784584807.978044:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:10466:x1871272549071616:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1784584807.978060:0:8782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584807.978077:0:8782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f5f expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.978108:0:8782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f58 expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.978118:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584807.978122:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584807.978128:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 7 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.978160:0:8782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f58 expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.978173:0:8782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f58 expref: 7 pid: 6608 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584807.978187:0:8782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff856300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8782:1871272569009280:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584807.978307:0:8782:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c3906c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584807.983459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584807.983672:0:8782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff856300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8782:1871272569009280:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584807.983744:0:8782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 7 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584807.983766:0:8782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed600, rc 0) 00000100:00100000:3.0:1784584807.983816:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:10466:x1871272549071616:12345-192.168.203.52@tcp:101:bash.0 Request processed in 5772us (5937us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584807.983825:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:1.0:1784584807.983976:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549071744 00000100:00100000:1.0:1784584807.983983:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549071744 00010000:00010000:1.0:1784584807.984012:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f58 expref: 7 pid: 6608 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584807.984046:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1784584807.984055:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549071744:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584807.984082:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584807.984104:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f58 expref: 7 pid: 6608 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.984118:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f58 expref: 7 pid: 6608 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.984142:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16a1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f58 expref: 7 pid: 6608 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.984158:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584807.984162:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584807.984170:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 6 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.984181:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 6 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584807.984213:0:5791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 6 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584807.984228:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5791:1871272569009408:192.168.203.52@tcp:105: 00000100:00100000:1.0:1784584807.984276:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584807.992879:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584807.993033:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549072000 00000100:00100000:3.0:1784584807.993041:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549072000 00000100:00100000:3.0:1784584807.993091:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1784584807.993101:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+33:10466:x1871272549072000:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1784584807.993399:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:10466:x1871272549072000:12345-192.168.203.52@tcp:35:bash.0 Request processed in 298us (537us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1784584807.993406:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:1.0:1784584807.993550:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5791:1871272569009408:192.168.203.52@tcp:105: 00010000:00010000:1.0:1784584807.993572:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584807.993602:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a83c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549071744:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 9549us (10152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584807.993610:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1784584808.179813:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.180041:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549072128 00000100:00100000:3.0:1784584808.180051:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549072128 00000100:00100000:3.0:1784584808.180122:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:3.0:1784584808.180132:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:10482:x1871272549072128:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584808.180164:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584808.180185:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff16af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f66 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.180260:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff16b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.180288:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff16b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.180300:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff16b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584808.180361:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1784584808.180365:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584808.180386:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff16b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.180420:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff16af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f66 expref: 36 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.180438:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff16b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f66 expref: 35 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.180446:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:3.0:1784584808.180449:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584808.180452:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaece00, rc 0) 00000100:00100000:3.0:1784584808.180503:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:10482:x1871272549072128:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 373us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584808.180511:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00080000:0.0:1784584808.181356:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584808.184664:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.185057:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549072384 00000100:00100000:0.0:1784584808.185067:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549072384 00000100:00100000:0.0:1784584808.185162:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1784584808.185172:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:10482:x1871272549072384:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584808.185192:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584808.185214:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff16bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f6d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.185317:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff16c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.185330:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff16c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.185339:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff16c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584808.185350:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784584808.185477:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff16bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f6d expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.185510:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff16c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f6d expref: 37 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.185518:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:0.0:1784584808.185520:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584808.185523:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfe00, rc 0) 00000100:00100000:0.0:1784584808.185587:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:10482:x1871272549072384:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 417us (933us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1784584808.185595:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:1.0:1784584808.195243:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.195340:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.196121:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549072640 00000100:00100000:3.0:1784584808.196131:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549072640 00000100:00100000:3.0:1784584808.196192:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:3.0:1784584808.196202:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:10482:x1871272549072640:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584808.196226:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584808.196258:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff16d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f74 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.196365:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff16d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.196677:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff16d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.196707:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff16d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584808.196722:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1784584808.196899:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff16d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f74 expref: 40 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.196920:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff16d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f74 expref: 39 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.197104:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:3.0:1784584808.197108:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784584808.197111:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed800, rc 0) 00000100:00100000:3.0:1784584808.197181:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+39:10482:x1871272549072640:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 979us (1945us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1784584808.197189:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:2.0:1784584808.197618:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549072768 00000100:00100000:2.0:1784584808.197626:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549072768 00000100:00100000:2.0:1784584808.197752:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1784584808.197762:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+39:2355:x1871272549072768:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584808.197774:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584808.197806:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff16c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f6d expref: 39 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.197820:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:2.0:1784584808.197824:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584808.197861:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:2355:x1871272549072768:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 101us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584808.197868:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1784584808.206365:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.206471:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549072896 00000100:00100000:0.0:1784584808.206481:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549072896 00000100:00100000:0.0:1784584808.206603:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1784584808.206615:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549072896:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:0.0:1784584808.206660:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.206680:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 6 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.206717:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584808.206723:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784584808.206728:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.206764:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 6 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.206803:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 6 pid: 8782 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584808.206820:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6608:1871272569009536:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584808.206901:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010da3c0 going to sleep for 11 seconds 00000100:00080000:2.0:1784584808.207520:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584808.209403:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa7a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6608:1871272569009536:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584808.209442:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.210920:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584808.211278:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549073024 00000100:00100000:2.0:1784584808.211288:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549073024 00002000:00100000:2.0:1784584808.211333:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97c801ab0380 x1871272549073024/t0(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:379/0 lens 504/0 e 0 to 0 dl 1784584819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784584808.211345:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c801ab0380 with x1871272549073024 ext(0->8) 00010000:00010000:2.0:1784584808.211356:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 7 pid: 8782 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.211374:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 7 pid: 8782 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584808.211395:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97c801ab0380 00000100:00100000:2.0:1784584808.211480:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1784584808.211491:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549073024:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:2.0:1784584808.212065:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2354:x1871272549073024:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 573us (1149us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784584808.212075:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00002000:00100000:2.0:1784584808.212084:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff97c801ab0380 x1871272549073024/t4294967302(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:379/0 lens 504/448 e 0 to 0 dl 1784584819 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784584808.212094:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c801ab0380 with x1871272549073024 ext(0->8) 00010000:00010000:2.0:1784584808.212102:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 9 pid: 8782 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.212117:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 9 pid: 8782 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584808.212139:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97c801ab0380 00000100:00100000:3.0:1784584808.219250:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.219435:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549073152 00000100:00100000:0.0:1784584808.219445:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549073152 00010000:00010000:0.0:1784584808.219488:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 9 pid: 8782 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584808.219535:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:0.0:1784584808.219555:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2355:x1871272549073152:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584808.219572:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784584808.219592:0:5792:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784584808.219595:0:5792:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784584807 00002000:00010000:0.0:1784584808.219598:0:5792:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784584807 00002000:00010000:0.0:1784584808.219600:0:5792:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784584807 00010000:00010000:0.0:1784584808.219607:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 9 pid: 8782 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.219639:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 9 pid: 8782 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.219664:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff16a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f5f expref: 9 pid: 8782 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.219681:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784584808.219685:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784584808.219734:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.219745:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.220035:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.220046:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.220072:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.220080:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.220088:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.220095:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf800 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584808.220100:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.220109:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.220122:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.220205:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a763e73d/0x787d778cc3ff16e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.220241:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584808.220339:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2355:x1871272549073152:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 793us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584808.220348:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1784584808.220444:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549072896:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 13832us (14087us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584808.220452:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1784584808.223329:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.225437:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549073408 00000100:00100000:1.0:1784584808.225451:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549073408 00000100:00100000:1.0:1784584808.225555:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:1.0:1784584808.225567:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f47c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:10482:x1871272549073408:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:1.0:1784584808.225636:0:5809:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff16d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f74 expref: 38 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784584808.225922:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1784584808.225982:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1784584808.226343:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1784584808.226402:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.226425:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f51 expref: 42 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.226436:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.226470:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f51 expref: 42 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.226501:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f51 expref: 42 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.226516:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1871272569009664:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584808.226591:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebe40 going to sleep for 11 seconds 00000100:00100000:3.0:1784584808.232163:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1871272569009664:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584808.232195:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584808.232551:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.232808:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549073536 00000100:00100000:1.0:1784584808.232815:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549073536 00010000:00010000:1.0:1784584808.232851:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f51 expref: 43 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.232885:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1784584808.232981:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+43:2355:x1871272549073536:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584808.232996:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584808.233003:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f51 expref: 43 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.233086:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f51 expref: 43 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.233108:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1693 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f51 expref: 43 pid: 5807 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.233122:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:1.0:1784584808.233126:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.233150:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.233157:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.233183:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584808.233243:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+42:2355:x1871272549073536:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 350us (700us total) trans 0 rc 0/0 00010000:00010000:3.0:1784584808.233284:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.233291:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784584808.233430:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1784584808.233622:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1784584808.233762:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff855c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569009792:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784584808.233808:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584808.233829:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d1683d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584808.235202:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569009792 00000100:00100000:0.0:1784584808.235213:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569009792 00000100:00100000:0.0:1784584808.235275:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584808.235284:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1871272569009792:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784584808.235386:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1871272569009792:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584808.235394:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1784584808.235437:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584808.235519:0:5809:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1784584808.235525:0:5809:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1784584808.235543:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7ff857100, transno 4294967301 00000100:00100000:3.0:1784584808.235556:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff855c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569009792:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784584808.237062:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1784584808.237146:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff855c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569009920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784584808.237197:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584808.237221:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d1683780 going to sleep for 11 seconds 00000100:00100000:2.0:1784584808.237432:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569009920 00000100:00100000:2.0:1784584808.237438:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569009920 00000100:00100000:2.0:1784584808.237490:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784584808.237502:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5809:x1871272569009920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784584808.237685:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff857100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5809:x1871272569009920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 187us (487us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1784584808.237720:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784584808.238000:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff855c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569009920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1784584808.238126:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1784584808.238169:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.238188:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.238196:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.238202:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584808.238207:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.238215:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.238231:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:3.0:1784584808.238233:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1784584808.238238:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.238244:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff16ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784584808.238488:0:5809:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1784584808.238860:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1784584808.238871:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 303346178337ns, next at 304346176010ns, rc = 0 00000001:00080000:3.0:1784584808.238878:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1784584808.238916:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c636f300) 00010000:00010000:3.0:1784584808.238919:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784584808.238927:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff16d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f74 expref: 47 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.239117:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1784584808.239294:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f47c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:10482:x1871272549073408:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 13728us (15972us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1784584808.239304:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000020:00080000:3.0:1784584808.239308:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1784584808.243185:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584808.243492:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549073664 00000100:00100000:2.0:1784584808.243502:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549073664 00000100:00100000:2.0:1784584808.243567:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1784584808.243576:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:10482:x1871272549073664:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584808.243602:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584808.243622:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff16f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f7b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.243686:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff16f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f7b expref: 46 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.243731:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff16f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f7b expref: 46 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.243827:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:3.0:1784584808.243831:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584808.243835:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2200, rc 0) 00000100:00100000:3.0:1784584808.243898:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+46:10482:x1871272549073664:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 321us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584808.243905:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:1.0:1784584808.247039:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.247209:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549073920 00000100:00100000:0.0:1784584808.247218:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549073920 00000100:00100000:0.0:1784584808.247312:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1784584808.247324:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+46:10482:x1871272549073920:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1784584808.247778:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:10482:x1871272549073920:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 451us (741us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1784584808.247788:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1784584808.330396:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.335605:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549074048 00000100:00100000:3.0:1784584808.335619:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549074048 00000100:00100000:2.0:1784584808.336828:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1784584808.336847:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:10492:x1871272549074048:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:2.0:1784584808.336921:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.336937:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.336957:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.336970:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.336977:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.336984:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338095:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338111:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338120:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584808.338164:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338187:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338210:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338217:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338223:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584808.338228:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338236:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338250:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:2.0:1784584808.338254:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584808.338258:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338265:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff16fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338278:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338283:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338289:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338294:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584808.338301:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338314:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338322:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c58a0000) 00010000:00010000:2.0:1784584808.338325:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584808.338328:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338334:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1703 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338347:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338353:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338358:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338363:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2a00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584808.338366:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338372:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338378:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:2.0:1784584808.338380:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584808.338386:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.338392:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff170a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584808.338479:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:10492:x1871272549074048:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1631us (8090us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584808.338488:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:3.0:1784584808.391382:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.391500:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549074304 00000100:00100000:0.0:1784584808.391510:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549074304 00000100:00100000:0.0:1784584808.391570:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:0.0:1784584808.391580:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:10495:x1871272549074304:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584808.391602:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584808.391622:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1711 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f82 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.391929:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392003:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392085:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392101:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392109:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392130:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392262:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392271:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392278:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584808.392288:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784584808.392379:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392387:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392393:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392398:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584808.392402:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392418:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392430:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584808.392433:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584808.392444:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392451:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1718 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392464:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392470:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392475:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392480:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584808.392483:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392488:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392496:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c636f100) 00010000:00010000:0.0:1784584808.392498:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584808.392501:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392507:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff171f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392548:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1711 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f82 expref: 50 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392574:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f82 expref: 49 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.392581:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584808.392584:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584808.392586:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be200, rc 0) 00000100:00100000:0.0:1784584808.392655:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+49:10495:x1871272549074304:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1075us (1280us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1784584808.392663:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 102 00000100:00100000:0.0:1784584808.399770:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.400318:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549074432 00000100:00100000:1.0:1784584808.400328:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549074432 00000100:00100000:1.0:1784584808.400390:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:1.0:1784584808.400400:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+49:10495:x1871272549074432:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1784584808.400477:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.400493:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.400504:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.400530:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.400536:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.400573:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.400580:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584808.400584:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.400591:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.400604:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:1.0:1784584808.400607:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784584808.400612:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.400619:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.400729:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+49:10495:x1871272549074432:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 331us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.400737:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:2.0:1784584808.403296:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.403373:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549074688 00000100:00100000:3.0:1784584808.403381:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549074688 00000100:00100000:3.0:1784584808.403437:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1784584808.403446:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+49:10495:x1871272549074688:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1784584808.403758:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:10495:x1871272549074688:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 312us (469us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1784584808.403766:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1784584808.524011:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.524121:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549074944 00000100:00100000:0.0:1784584808.524131:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549074944 00000100:00100000:0.0:1784584808.524312:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:0.0:1784584808.524323:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:10505:x1871272549074944:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584808.524348:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584808.524351:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784584808.524381:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff16b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f66 expref: 50 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.524402:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584808.524408:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584808.524432:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff173b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f89 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.524554:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.524575:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.524587:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584808.524599:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784584808.524823:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff173b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f89 expref: 52 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.524841:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f89 expref: 51 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.524848:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584808.524850:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584808.524854:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf200, rc 0) 00000100:00100000:0.0:1784584808.524916:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:10505:x1871272549074944:12345-192.168.203.52@tcp:101:bash.0 Request processed in 595us (914us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1784584808.524924:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 104 00000100:00100000:1.0:1784584808.531305:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.531485:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549075200 00000100:00100000:3.0:1784584808.531499:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549075200 00000100:00100000:3.0:1784584808.531568:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:3.0:1784584808.531579:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:10505:x1871272549075200:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:3.0:1784584808.531646:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1784584808.531674:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f89 expref: 51 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.531733:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f82 expref: 50 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.531745:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:3.0:1784584808.531750:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584808.532179:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.532193:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.532204:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784584808.532266:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1784584808.532296:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000395b4382 reply state 00000000ca103836 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584808.532305:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784584808.532395:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10505:x1871272549075200:12345-192.168.203.52@tcp:36:bash.0 Request processed in 817us (1099us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1784584808.532402:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000020:00080000:3.0:1784584808.532407:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784584808.534183:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.534216:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.534222:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.534229:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584808.534233:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.534241:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.534256:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:3.0:1784584808.534259:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584808.534264:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.534269:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff1750 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.537007:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584808.537106:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549075328 00000100:00100000:2.0:1784584808.537115:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549075328 00000100:00100000:2.0:1784584808.537208:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:2.0:1784584808.537229:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:10505:x1871272549075328:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1784584808.537253:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584808.537273:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1757 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f90 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.537377:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.537391:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.537403:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584808.537444:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784584808.537448:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584808.537467:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.537506:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1757 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f90 expref: 53 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.537523:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f90 expref: 52 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584808.537532:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:2.0:1784584808.537535:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584808.537539:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3e00, rc 0) 00000100:00100000:2.0:1784584808.537604:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10505:x1871272549075328:12345-192.168.203.52@tcp:101:bash.0 Request processed in 377us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584808.537611:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:1.0:1784584808.543306:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.543423:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549075584 00000100:00100000:3.0:1784584808.543433:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549075584 00000100:00100000:3.0:1784584808.543489:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1784584808.543499:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10505:x1871272549075584:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1784584808.543840:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10505:x1871272549075584:12345-192.168.203.52@tcp:35:bash.0 Request processed in 340us (541us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1784584808.543847:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:3.0:1784584808.612443:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.612631:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549075712 00000100:00100000:1.0:1784584808.612640:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549075712 00000100:00100000:1.0:1784584808.612769:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:1.0:1784584808.612781:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:10511:x1871272549075712:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584808.612808:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584808.612836:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1765 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f97 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.612923:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff176c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.612945:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff176c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.612958:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff176c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584808.613018:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1784584808.613021:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584808.613043:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff176c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.613080:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1765 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f97 expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.613099:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff176c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f97 expref: 54 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.613108:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:1.0:1784584808.613111:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584808.613114:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818800, rc 0) 00000100:00100000:1.0:1784584808.613176:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10511:x1871272549075712:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 397us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.613182:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:1.0:1784584808.617273:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.617557:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549075840 00000100:00100000:0.0:1784584808.617567:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549075840 00000100:00100000:0.0:1784584808.617616:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:0.0:1784584808.617625:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10511:x1871272549075840:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584808.617644:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584808.617662:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1773 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2f9e expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.617822:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.617838:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.617848:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.617864:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.617872:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.617879:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.617965:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.617974:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.617981:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584808.618013:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784584808.618017:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584808.618036:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618058:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618067:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618074:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618081:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618086:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584808.618090:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618097:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618108:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584808.618111:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584808.618114:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618120:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff177a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618131:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618367:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618390:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618396:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584808.618399:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618406:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618422:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c636f100) 00010000:00010000:0.0:1784584808.618425:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584808.618428:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618433:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1781 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618467:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1773 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f9e expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618480:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f9e expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.618487:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584808.618489:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584808.618492:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf200, rc 0) 00000100:00100000:0.0:1784584808.618556:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10511:x1871272549075840:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 932us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584808.618573:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:2.0:1784584808.624217:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584808.624324:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.625866:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549076224 00000100:00100000:0.0:1784584808.625882:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549076224 00000100:00100000:0.0:1784584808.625970:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1784584808.625981:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:2355:x1871272549076224:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584808.625996:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584808.626021:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f9e expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.626038:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584808.626044:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584808.626118:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:2355:x1871272549076224:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 139us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584808.626127:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1784584808.628243:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549076096 00000100:00100000:1.0:1784584808.628259:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549076096 00000100:00100000:1.0:1784584808.628394:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:1.0:1784584808.628406:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10511:x1871272549076096:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584808.628438:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584808.628461:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff178f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fa5 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.628564:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.628579:0:6997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f90 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.628587:0:6997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.628627:0:6997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f90 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.628641:0:6997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f90 expref: 55 pid: 5806 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.628658:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569010048:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584808.628802:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb480 going to sleep for 11 seconds 00000100:00100000:2.0:1784584808.635350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.635788:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569010048:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584808.635819:0:6997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584808.635840:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549076352 00000100:00100000:3.0:1784584808.635850:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549076352 00010000:00010000:3.0:1784584808.635904:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f90 expref: 56 pid: 5806 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584808.635954:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1784584808.635964:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:2354:x1871272549076352:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584808.635979:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584808.635986:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f90 expref: 56 pid: 5806 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.635999:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f90 expref: 56 pid: 5806 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.636021:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff175e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f90 expref: 56 pid: 5806 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.636038:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:3.0:1784584808.636044:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.636053:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.636061:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.636088:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584808.636120:0:6997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.636130:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584808.636145:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:2354:x1871272549076352:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 181us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584808.636161:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000004:00200000:1.0:1784584808.636162:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784584808.636307:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff178f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fa5 expref: 56 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.636323:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fa5 expref: 55 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.636330:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:1.0:1784584808.636333:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784584808.636336:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819200, rc 0) 00000100:00100000:1.0:1784584808.636363:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10511:x1871272549076096:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 7960us (12158us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1784584808.636370:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:2.0:1784584808.641085:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.641445:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549076608 00000100:00100000:0.0:1784584808.641456:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549076608 00000100:00100000:0.0:1784584808.641524:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:0.0:1784584808.641536:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10511:x1871272549076608:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:0.0:1784584808.641552:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584808.641577:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff16f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f7b expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.641598:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584808.641603:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584808.641667:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10511:x1871272549076608:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 134us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584808.641975:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1784584808.644854:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.646510:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549076736 00000100:00100000:0.0:1784584808.646525:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549076736 00000100:00100000:0.0:1784584808.646599:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:0.0:1784584808.646611:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10511:x1871272549076736:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:0.0:1784584808.646777:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.646795:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.646807:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784584808.647167:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1784584808.647304:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10511:x1871272549076736:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 695us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584808.647310:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:2.0:1784584808.652025:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.652358:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549076864 00000100:00100000:3.0:1784584808.652368:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549076864 00000100:00100000:3.0:1784584808.652622:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 111 00000100:00100000:3.0:1784584808.652634:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:10511:x1871272549076864:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584808.652654:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584808.652673:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff17ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fac expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.652761:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.652773:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff17ab lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fac expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.652792:0:5808:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.652805:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff17ab lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fac expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.652818:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:3.0:1784584808.652822:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584808.652826:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff17ab lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fac expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.652835:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed200, rc 0) 00000100:00100000:3.0:1784584808.652904:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10511:x1871272549076864:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 272us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584808.652911:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 111 00010000:00010000:0.0:1784584808.732520:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784584808.734653:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584808.734664:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584808.734771:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1784584808.734779:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784584808.735143:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa7bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569010176:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784584808.735233:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010da3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584808.739198:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa7bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569010176:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784584808.742200:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.742818:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549076992 00000100:00100000:0.0:1784584808.742845:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549076992 00000100:00100000:0.0:1784584808.742925:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:0.0:1784584808.742943:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10512:x1871272549076992:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784584808.742975:0:5806:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784584808.743526:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10512:x1871272549076992:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 590us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584808.743535:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 112 00000100:00100000:2.0:1784584808.762497:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.762855:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549077120 00000100:00100000:1.0:1784584808.762864:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549077120 00000100:00100000:1.0:1784584808.762928:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:1.0:1784584808.762938:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10512:x1871272549077120:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1784584808.763005:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763022:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763058:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763113:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763121:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763127:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763151:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763160:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763166:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584808.763215:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1784584808.763220:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584808.763233:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763243:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763250:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763267:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763273:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584808.763277:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763286:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763298:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:1.0:1784584808.763301:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584808.763514:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763522:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff17b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763535:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763541:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763547:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763552:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819a00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584808.763554:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763570:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763578:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584808.763580:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584808.763583:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763587:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff17b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763600:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763605:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763609:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763614:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584808.763616:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763621:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763628:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:1.0:1784584808.763630:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584808.763633:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.763651:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.763775:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10512:x1871272549077120:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 837us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.763783:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 113 00000100:00100000:2.0:1784584808.766829:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.766920:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549077376 00000100:00100000:0.0:1784584808.766929:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549077376 00000100:00100000:0.0:1784584808.766988:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:0.0:1784584808.766998:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:10512:x1871272549077376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584808.767017:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584808.767047:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff17c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fb3 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.767140:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.767155:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.767166:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584808.767179:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784584808.767278:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.767286:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.767615:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.767623:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584808.767628:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.767635:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.767647:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584808.767650:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784584808.767654:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.767661:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff17ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.768125:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff17c7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fb3 expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.768138:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:0.0:1784584808.768141:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584808.768144:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff17c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fb3 expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.768155:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be000, rc 0) 00000100:00100000:0.0:1784584808.768269:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:10512:x1871272549077376:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1271us (1447us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1784584808.768291:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 114 00000100:00100000:2.0:1784584808.777282:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.777326:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549077504 00000100:00100000:1.0:1784584808.777335:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549077504 00000100:00100000:1.0:1784584808.777392:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:1.0:1784584808.777401:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:10512:x1871272549077504:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784584808.777465:0:6997:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784584808.777565:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:10512:x1871272549077504:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 164us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.777572:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 115 00000100:00100000:2.0:1784584808.784873:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.793477:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549077760 00000100:00100000:3.0:1784584808.793492:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549077760 00000100:00100000:3.0:1784584808.793570:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:3.0:1784584808.793581:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:10512:x1871272549077760:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584808.793601:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584808.793604:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784584808.793630:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff176c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f97 expref: 56 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.793655:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:3.0:1784584808.793659:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584808.793669:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff17dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fba expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784584808.794781:0:5807:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1784584808.795038:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff17e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.795053:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff17e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.795064:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff17e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.795125:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff17dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fba expref: 58 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.795165:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff17e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fba expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.795971:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7e189cb00) 00010000:00010000:3.0:1784584808.795975:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784584808.795979:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec000, rc 0) 00000100:00100000:3.0:1784584808.796163:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:10512:x1871272549077760:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2580us (11297us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1784584808.796172:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 116 00000100:00100000:2.0:1784584808.800637:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.801296:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549078016 00000100:00100000:3.0:1784584808.801307:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549078016 00000100:00100000:3.0:1784584808.801442:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:3.0:1784584808.801458:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:10512:x1871272549078016:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784584808.801519:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584808.801545:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff17e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fba expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801566:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7e189cb00) 00010000:00010000:3.0:1784584808.801577:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584808.801598:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801612:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801622:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801650:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801657:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801664:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801753:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801760:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801767:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801772:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584808.801777:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801783:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801792:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:3.0:1784584808.801795:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584808.801799:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801805:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff17f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801833:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801839:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801846:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801851:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584808.801854:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801860:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801869:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xca4dffc9 (ffff97c7e189c900) 00010000:00010000:3.0:1784584808.801871:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584808.801873:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.801878:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff17f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xca4dffc9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584808.801978:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:10512:x1871272549078016:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 522us (1349us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784584808.801990:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 117 00000100:00100000:2.0:1784584808.818276:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.820184:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549078144 00000100:00100000:0.0:1784584808.820198:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549078144 00000100:00100000:1.0:1784584808.820634:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:1.0:1784584808.820647:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:10512:x1871272549078144:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584808.820668:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584808.820714:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fc1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.820752:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.820766:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.820777:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.820901:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff17ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc1 expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.820921:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc1 expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.820931:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584808.820943:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784584808.820947:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819a00, rc 0) 00000100:00100000:1.0:1784584808.821190:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:10512:x1871272549078144:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 544us (2922us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.821198:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 118 00000100:00100000:2.0:1784584808.828287:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.828469:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549078400 00000100:00100000:1.0:1784584808.828480:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549078400 00000100:00100000:1.0:1784584808.828539:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 119 00000100:00100000:1.0:1784584808.828548:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:10512:x1871272549078400:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784584808.828626:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.828643:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.828654:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784584808.830463:0:6997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:1.0:1784584808.830566:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000012742d99 reply state 0000000080a22b19 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.830589:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584808.832304:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:10512:x1871272549078400:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 3748us (4018us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1784584808.832315:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 119 00010000:00010000:1.0:1784584808.840295:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.840313:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.840321:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.840327:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584808.840332:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.840339:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.840354:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584808.840357:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784584808.840362:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.840367:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff180d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584808.842366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.843549:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549078528 00000100:00100000:3.0:1784584808.843562:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549078528 00000100:00100000:1.0:1784584808.845839:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:1.0:1784584808.845868:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:10512:x1871272549078528:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584808.846211:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584808.846233:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fc8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.846311:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc8 expref: 59 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.846327:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc8 expref: 59 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.846345:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584808.846348:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784584808.846351:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818000, rc 0) 00000100:00100000:1.0:1784584808.846548:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:10512:x1871272549078528:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 695us (4188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.846556:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:2.0:1784584808.851128:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.853330:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549078656 00000100:00100000:1.0:1784584808.853346:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549078656 00000100:00100000:1.0:1784584808.853614:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:1.0:1784584808.853626:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2354:x1871272549078656:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784584808.854260:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2354:x1871272549078656:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 634us (3138us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784584808.854269:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:3.0:1784584808.862591:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.867612:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549078912 00000100:00100000:0.0:1784584808.867626:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549078912 00000100:00100000:0.0:1784584808.867844:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1784584808.867864:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:10512:x1871272549078912:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784584808.868369:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:10512:x1871272549078912:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 514us (5787us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1784584808.868451:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:2.0:1784584808.876099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.876469:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549079168 00000100:00100000:1.0:1784584808.876478:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549079168 00000100:00100000:1.0:1784584808.876538:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:1.0:1784584808.876548:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:10512:x1871272549079168:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784584808.876746:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:10512:x1871272549079168:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 198us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.876755:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 121 00000100:00100000:2.0:1784584808.893015:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.893090:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549079296 00000100:00100000:1.0:1784584808.893100:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549079296 00000100:00100000:1.0:1784584808.893171:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1784584808.893181:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:10512:x1871272549079296:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584808.893201:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584808.893223:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff181b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fcf expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.893289:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.893303:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.893314:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584808.893353:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584808.893371:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.893539:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff181b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fcf expref: 62 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.893557:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fcf expref: 61 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.893584:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584808.893587:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784584808.893590:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819000, rc 0) 00000100:00100000:1.0:1784584808.893651:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:10512:x1871272549079296:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 472us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.893659:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:3.0:1784584808.900088:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.900271:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549079424 00000100:00100000:1.0:1784584808.900280:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549079424 00000100:00100000:1.0:1784584808.900334:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:1.0:1784584808.900343:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2355:x1871272549079424:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584808.900361:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584808.901089:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fd6 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784584808.901119:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e9a68, blocks: 0x1 00010000:00010000:1.0:1784584808.901315:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1784584808.901321:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584808.901332:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fd6 expref: 10 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.901355:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fd6 expref: 10 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.901370:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818200, rc 0) 00000100:00100000:1.0:1784584808.901871:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:2355:x1871272549079424:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1527us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.901879:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:2.0:1784584808.907543:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.907826:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549079680 00000100:00100000:1.0:1784584808.907837:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549079680 00000100:00100000:1.0:1784584808.907898:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:1.0:1784584808.907909:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:10512:x1871272549079680:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784584808.908477:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:10512:x1871272549079680:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 559us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.908486:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 123 00000100:00100000:2.0:1784584808.922796:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584808.922883:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549079808 00000100:00100000:3.0:1784584808.922901:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549079808 00000100:00100000:3.0:1784584808.922970:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:3.0:1784584808.922980:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:10512:x1871272549079808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584808.923000:0:8782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584808.923017:0:8782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fdd expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.923049:0:8782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fd6 expref: 11 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.923058:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584808.923063:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584808.923069:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 11 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.923102:0:8782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fd6 expref: 11 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584808.923116:0:8782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fd6 expref: 11 pid: 6605 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584808.923131:0:8782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8782:1871272569010304:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584808.923240:0:8782:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e02fc900 going to sleep for 11 seconds 00000100:00100000:2.0:1784584808.932444:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584808.932550:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549079936 00000100:00100000:1.0:1784584808.932560:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549079936 00010000:00010000:1.0:1784584808.932601:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fd6 expref: 12 pid: 6605 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.932645:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1784584808.932656:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+12:2355:x1871272549079936:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584808.932672:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584808.932747:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fd6 expref: 12 pid: 6605 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.932770:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fd6 expref: 12 pid: 6605 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.932795:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584808.932800:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584808.932823:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 12 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.932833:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 12 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584808.932900:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 12 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584808.932927:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5790:1871272569010432:192.168.203.52@tcp:105: 00000100:00100000:1.0:1784584808.933004:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb300 going to sleep for 11 seconds 00010000:00010000:0.0:1784584808.936283:0:8782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b173e37/0x787d778cc3ff1829 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fd6 expref: 12 pid: 6605 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584808.936317:0:8782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8782:1871272569010304:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584808.936350:0:8782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 11 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584808.936365:0:8782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed000, rc 0) 00000100:00100000:2.0:1784584808.936634:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+11:10512:x1871272549079808:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 13653us (13846us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584808.936643:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1784584808.939837:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5790:1871272569010432:192.168.203.52@tcp:105: 00010000:00010000:1.0:1784584808.939861:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584808.940105:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a80850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:2355:x1871272549079936:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 7449us (7669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584808.940115:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:3.0:1784584808.944859:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584808.945463:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549080064 00000100:00100000:0.0:1784584808.945475:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549080064 00002000:00100000:0.0:1784584808.945528:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97c801b1ca80 x1871272549080064/t0(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:379/0 lens 504/0 e 0 to 0 dl 1784584819 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784584808.945540:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c801b1ca80 with x1871272549080064 ext(0->12) 00002000:00010000:0.0:1784584808.945545:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c801b1ca80 00000100:00100000:0.0:1784584808.945578:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1784584808.945587:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:2355:x1871272549080064:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784584808.947450:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+12:2355:x1871272549080064:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 1855us (2592us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1784584808.947528:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:2.0:1784584808.947541:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff97c801b1ca80 x1871272549080064/t4294967308(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:379/0 lens 504/448 e 0 to 0 dl 1784584819 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784584808.947552:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c801b1ca80 with x1871272549080064 ext(0->12) 00002000:00010000:2.0:1784584808.947557:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c801b1ca80 00000100:00100000:3.0:1784584808.956734:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584808.957335:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549080192 00000100:00100000:2.0:1784584808.957345:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549080192 00000100:00100000:2.0:1784584808.957415:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:2.0:1784584808.957426:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:10512:x1871272549080192:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784584809.010507:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1784584809.010542:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1784584809.010962:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:10512:x1871272549080192:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 53410us (54143us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584809.010975:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000020:00080000:2.0:1784584809.011502:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c6c1917600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1784584809.011508:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7e02f6400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c6c1917a80 00000020:00080000:2.0:1784584809.011512:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7c32c9b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c7f42cb400 00000004:00080000:2.0:1784584809.011563:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1784584809.011583:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1784584809.011606:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1784584809.011620:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c7d1683d80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1784584809.011623:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7c405db00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c7d16836c0 00000020:00080000:2.0:1784584809.011626:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7c405dd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c7efd66400 00000100:00100000:2.0:1784584809.011772:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c640c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569010560:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784584809.011828:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1784584809.012096:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1784584809.012272:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1784584809.013010:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584809.013024:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c640ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569010688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784584809.013072:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584809.013151:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569010560 00000100:00100000:1.0:1784584809.013158:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569010560 00000100:00100000:1.0:1784584809.013210:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569010688 00000100:00100000:1.0:1784584809.013213:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569010688 00000100:00100000:1.0:1784584809.013234:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784584809.013242:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3322:x1871272569010560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1784584809.013279:0:6605:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1784584809.013304:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.013325:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f3c expref: 11 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.013335:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1784584809.013340:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584809.013345:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.013372:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f3c expref: 11 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.013385:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f3c expref: 11 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584809.013397:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6605:1871272569010816:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584809.013646:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebe40 going to sleep for 11 seconds 00000100:00100000:1.0:1784584809.013665:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784584809.013673:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3322:x1871272569010688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1784584809.013687:0:6607:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1784584809.013733:0:6607:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a5e9a67, atime: 0x6a5e9a67, ctime: 0x6a5e9a67, blocks: 0x1 00010000:00010000:1.0:1784584809.013739:0:6607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784584809.013916:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784584809.014082:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=304s v=(0 0) 00010000:00010000:1.0:1784584809.014087:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584809.014094:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.014108:0:6607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.014119:0:6607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.014126:0:6607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.014148:0:6607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584809.014633:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584809.014641:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.014650:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819600 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584809.014654:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.014663:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.014680:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.014687:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5b71b69/0x787d778cc3ff183e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.014725:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584809.014727:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584809.014728:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584809.015770:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3322:x1871272569010688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2084us (2683us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784584809.015781:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1784584809.016425:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7c640ca80/2, rc 0, transno 4294967304 00000100:00100000:2.0:1784584809.016435:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c640ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569010688:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784584809.020242:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584809.020344:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549080320 00000100:00100000:3.0:1784584809.020354:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549080320 00010000:00010000:3.0:1784584809.020474:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f3c expref: 12 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584809.020523:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:3.0:1784584809.020533:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+12:2354:x1871272549080320:12345-192.168.203.52@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1784584809.020536:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6605:1871272569010816:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584809.020549:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584809.020556:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f3c expref: 12 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.020570:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f3c expref: 12 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.020591:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006faf6553/0x787d778cc3ff15f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f3c expref: 12 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.020607:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784584809.020612:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784584809.020619:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.020627:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.020648:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584809.020810:0:6605:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.020822:0:6605:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.020841:0:6605:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.020851:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.020859:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.020872:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784584809.020997:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+11:2354:x1871272549080320:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 464us (763us total) trans 0 rc 0/0 00010000:00010000:0.0:1784584809.021005:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1784584809.021009:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00010000:00010000:0.0:1784584809.021015:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.021025:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584809.021036:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.021046:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.021060:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.021067:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1837 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.021083:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584809.021089:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584809.021091:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584809.021118:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584809.023858:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3322:x1871272569010560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10609us (12021us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1784584809.023872:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:2.0:1784584809.024272:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7c640c380/2, rc 0, transno 4294967309 00000100:00100000:2.0:1784584809.024301:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c640c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569010560:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784584809.032430:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584809.032750:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549080448 00000100:00100000:3.0:1784584809.032761:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549080448 00000100:00100000:3.0:1784584809.032820:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1784584809.032831:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+11:2357:x1871272549080448:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1784584809.105908:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1784584809.105924:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1784584809.105931:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1784584809.106159:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3e55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549080448:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 73324us (73744us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584809.106177:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:2.0:1784584809.109454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584809.109783:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549080704 00000100:00100000:1.0:1784584809.109791:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549080704 00000100:00100000:1.0:1784584809.109895:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:1.0:1784584809.109906:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:10512:x1871272549080704:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784584809.109958:0:6997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584809.109985:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fcf expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.110003:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584809.110020:0:6997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584809.110053:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.110067:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.110086:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584809.110311:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a139683 reply state 0000000030bc62b4 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584809.110321:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584809.110416:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:10512:x1871272549080704:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 504us (961us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1784584809.110424:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:2.0:1784584809.113961:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584809.114377:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549080832 00000100:00100000:1.0:1784584809.114388:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549080832 00000100:00100000:1.0:1784584809.114464:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1784584809.114474:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549080832:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1784584809.114751:0:6607:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784584809.114755:0:6607:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784584808 00002000:00010000:1.0:1784584809.114757:0:6607:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784584807 00002000:00010000:1.0:1784584809.114759:0:6607:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784584808 -> 1784584808 00002000:00010000:1.0:1784584809.114762:0:6607:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1784584809.114827:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2357:x1871272549080832:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 354us (875us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1784584809.114836:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00010000:00010000:3.0:1784584809.115535:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.115547:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.115555:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.115561:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584809.115565:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.115572:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.115588:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:3.0:1784584809.115591:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584809.115595:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.115601:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818800/0x787d778cc3ff1845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584809.118174:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584809.118249:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549081088 00000100:00100000:1.0:1784584809.118258:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549081088 00000100:00100000:1.0:1784584809.118315:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:1.0:1784584809.118326:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:10512:x1871272549081088:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784584809.118403:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.118428:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc1 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.118438:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.118473:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc1 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.118486:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc1 expref: 15 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584809.118501:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569010944:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584809.118597:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb900 going to sleep for 11 seconds 00000100:00100000:1.0:1784584809.121518:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569010944:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584809.121548:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584809.122811:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584809.122907:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549081216 00000100:00100000:3.0:1784584809.122915:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549081216 00010000:00010000:3.0:1784584809.122957:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc1 expref: 16 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584809.122996:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1784584809.123006:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:2354:x1871272549081216:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584809.123020:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584809.123027:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc1 expref: 16 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.123040:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc1 expref: 16 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.123064:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff1806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc1 expref: 16 pid: 5806 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.123079:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:3.0:1784584809.123084:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.123093:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.123100:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.123135:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584809.123195:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:2354:x1871272549081216:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 190us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584809.123203:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00010000:00010000:2.0:1784584809.123319:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.123326:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.123359:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.123366:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.123373:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.123379:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584809.123383:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.123390:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.123399:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:2.0:1784584809.123402:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784584809.123415:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.123421:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff184c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584809.123464:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:10512:x1871272549081088:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 5139us (5298us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784584809.123473:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 126 00000100:00100000:0.0:1784584809.126981:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584809.127111:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549081344 00000100:00100000:2.0:1784584809.127121:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549081344 00000100:00100000:2.0:1784584809.127182:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:2.0:1784584809.127210:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2356:x1871272549081344:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784584809.127256:0:8782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.127277:0:8782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 7 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.127287:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584809.127292:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584809.127296:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.127330:0:8782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 7 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.127344:0:8782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 7 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584809.127359:0:8782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c640fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8782:1871272569011072:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584809.127446:0:8782:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584809.129558:0:8782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c640fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8782:1871272569011072:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584809.129589:0:8782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584809.138237:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584809.139667:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549081472 00000100:00100000:1.0:1784584809.139681:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549081472 00010000:00010000:1.0:1784584809.140288:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 8 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584809.140419:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:1.0:1784584809.140429:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2354:x1871272549081472:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584809.140445:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584809.140469:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 8 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.140483:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 8 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.140506:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000881f27af/0x787d778cc3ff1830 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fdd expref: 8 pid: 8782 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.140522:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584809.140526:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584809.140532:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.140541:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.140575:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584809.140639:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549081472:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 210us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584809.140646:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00010000:00010000:2.0:1784584809.140728:0:8782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.140745:0:8782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.140769:0:8782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.140777:0:8782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.140785:0:8782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.140793:0:8782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584809.140797:0:8782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.140806:0:8782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.140818:0:8782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.140825:0:8782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1853 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584809.140903:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2356:x1871272549081344:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 13695us (13930us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584809.140912:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1784584809.143784:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584809.144026:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549081728 00000100:00100000:3.0:1784584809.144035:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549081728 00000100:00100000:3.0:1784584809.144210:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 127 00000100:00100000:3.0:1784584809.144221:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:10512:x1871272549081728:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784584809.144311:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.144330:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.144341:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.144587:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.144598:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc8 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.144607:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.144643:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc8 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.144656:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc8 expref: 15 pid: 5807 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584809.145209:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569011200:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584809.145286:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b000 going to sleep for 11 seconds 00000100:00100000:3.0:1784584809.148498:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569011200:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584809.148528:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584809.148906:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584809.149194:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549081856 00000100:00100000:1.0:1784584809.149202:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549081856 00010000:00010000:1.0:1784584809.149241:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc8 expref: 16 pid: 5807 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584809.149283:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1784584809.149292:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+16:2354:x1871272549081856:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584809.149306:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584809.149314:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc8 expref: 16 pid: 5807 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.149325:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc8 expref: 16 pid: 5807 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.149346:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff1814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fc8 expref: 16 pid: 5807 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.149362:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:1.0:1784584809.149367:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.149376:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.149384:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.149421:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584809.149469:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:2354:x1871272549081856:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 177us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584809.149489:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00010000:00010000:2.0:1784584809.149615:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.149623:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784584809.149861:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1784584809.150034:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1784584809.150473:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1784584809.150561:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c640fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5808:1871272569011328:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784584809.150616:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584809.150648:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584809.150675:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569011328 00000100:00100000:2.0:1784584809.150680:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569011328 00000100:00100000:2.0:1784584809.150739:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784584809.150748:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1871272569011328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784584809.150814:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1871272569011328:12345-0@lo:1000:mdt00_002.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584809.150821:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784584809.150860:0:5808:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1784584809.150866:0:5808:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1784584809.150885:0:5808:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7c640c380, transno 4294967309 00000100:00100000:2.0:1784584809.150899:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c640fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5808:1871272569011328:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1784584809.151594:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1784584809.151652:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c640fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5808:1871272569011456:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784584809.151688:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584809.151730:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584809.151748:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569011456 00000100:00100000:2.0:1784584809.151752:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569011456 00000100:00100000:2.0:1784584809.151780:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584809.151787:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1871272569011456:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1784584809.153059:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1871272569011456:12345-0@lo:1000:mdt00_002.0 Request processed in 1263us (1361us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784584809.153071:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784584809.154285:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c640fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5808:1871272569011456:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1784584809.154418:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154430:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154438:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154459:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584809.154464:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154472:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154489:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:0.0:1784584809.154492:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584809.154497:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154504:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1861 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154539:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154546:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154552:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154557:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584809.154560:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154566:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154587:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584809.154590:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584809.154597:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff17ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fac expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154608:0:5808:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff17ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fac expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154617:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff17ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fac expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.154653:0:5808:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff17ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fac expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584809.154667:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569011584:192.168.203.52@tcp:105: 00000100:00100000:0.0:1784584809.155181:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f57eff00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584809.160515:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa79c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569011584:192.168.203.52@tcp:105: 00010000:00010000:2.0:1784584809.160548:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160559:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff17a4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160591:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160606:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160617:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160627:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160652:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160659:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160665:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584809.160669:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160677:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.160689:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:2.0:1784584809.161437:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584809.161444:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.161452:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1868 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.161465:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.161472:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.161478:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.161483:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaeca00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584809.161497:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.161504:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.161516:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:2.0:1784584809.161518:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784584809.161521:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.161527:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff185a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584809.162087:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:10512:x1871272549081728:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 17856us (18299us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1784584809.162098:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 127 00000020:00080000:2.0:1784584809.162104:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1784584809.163619:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584809.163875:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549081984 00000100:00100000:3.0:1784584809.163884:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549081984 00000100:00100000:3.0:1784584809.164163:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:3.0:1784584809.164175:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:10511:x1871272549081984:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:3.0:1784584809.164301:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:10511:x1871272549081984:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 128us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584809.164308:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:1.0:1784584809.166275:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584809.166307:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549082240 00000100:00100000:1.0:1784584809.166315:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549082240 00000100:00100000:1.0:1784584809.166353:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:1.0:1784584809.166363:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f44850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:10512:x1871272549082240:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000040:00080000:0.0:1784584809.167087:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584809.167094:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000004:00080000:1.0:1784584809.167493:0:5809:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784584809.167580:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000040:00080000:0.0:1784584809.167611:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1784584809.167619:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784584809.167628:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.167643:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.167654:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.167661:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.167667:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.167674:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584809.167720:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584809.168555:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584809.168564:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.168574:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584809.168578:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.168602:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.168618:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff97c7d6b88300) 00010000:00010000:0.0:1784584809.168621:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784584809.168625:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.168632:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff186f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584809.168651:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584809.168653:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584809.168655:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584809.169914:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f44850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:10512:x1871272549082240:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 3544us (3640us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1784584809.169944:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000020:00080000:1.0:1784584809.169952:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784584809.171670:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584809.171928:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549082496 00000100:00100000:2.0:1784584809.171946:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549082496 00000100:00100000:2.0:1784584809.172181:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:2.0:1784584809.172193:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:10511:x1871272549082496:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:2.0:1784584809.172444:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1784584809.172580:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:10511:x1871272549082496:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 388us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584809.172588:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 128 00000100:00100000:0.0:1784584809.206965:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584809.207307:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549082624 00000100:00100000:2.0:1784584809.207319:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549082624 00000100:00100000:2.0:1784584809.207430:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1784584809.207455:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:10514:x1871272549082624:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584809.207480:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584809.207502:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2fe4 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.207585:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.207600:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.207626:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.207643:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.207649:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.207656:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.208017:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.208028:0:6997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fa5 expref: 21 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.208036:0:6997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.209349:0:6997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fa5 expref: 21 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.209370:0:6997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fa5 expref: 21 pid: 6997 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584809.209385:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c640df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569011712:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584809.209565:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784584809.216887:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c640df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569011712:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584809.216924:0:6997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584809.223613:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584809.223733:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549082880 00000100:00100000:2.0:1784584809.223743:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549082880 00000100:00100000:2.0:1784584809.223812:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1784584809.223823:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:5567:x1871272549082880:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784584809.224066:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:5567:x1871272549082880:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 243us (459us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1784584809.224074:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:2.0:1784584809.227679:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584809.227802:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549083008 00000100:00100000:3.0:1784584809.227820:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549083008 00010000:00010000:3.0:1784584809.227862:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fa5 expref: 23 pid: 6997 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584809.227952:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:3.0:1784584809.227963:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:2354:x1871272549083008:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584809.227978:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584809.227986:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fa5 expref: 23 pid: 6997 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.227998:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fa5 expref: 23 pid: 6997 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.228037:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1796 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fa5 expref: 23 pid: 6997 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.228054:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:3.0:1784584809.228060:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.228069:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.228076:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584809.228110:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584809.228159:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:2354:x1871272549083008:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 197us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584809.228168:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00010000:00010000:2.0:1784584809.228222:0:6997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228231:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584809.228277:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784584809.228282:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584809.228300:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228325:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228335:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228342:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228348:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228354:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584809.228359:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228366:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228375:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:2.0:1784584809.228378:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584809.228381:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228386:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff187d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228395:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228401:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228423:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228428:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584809.228431:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228437:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.228446:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff97c7c58a0000) 00010000:00010000:2.0:1784584809.228448:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584809.228451:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.232293:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.232372:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fe4 expref: 22 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.232391:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fe4 expref: 21 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584809.232401:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:2.0:1784584809.232414:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584809.232418:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2600, rc 0) 00000100:00100000:2.0:1784584809.232494:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:10514:x1871272549082624:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 25040us (25537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584809.232521:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00010000:00010000:0.0:1784584809.756382:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784584810.052059:0:11969:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584810.052069:0:11969:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584810.052116:0:11969:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784584810.052123:0:11969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1784584810.221134:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784584810.221145:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784584810.221206:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1784584810.221214:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784584810.221355:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569011840:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784584810.221487:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b540 going to sleep for 11 seconds 00000100:00100000:3.0:1784584810.233957:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569011840:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784584810.242591:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584810.245734:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549083136 00000100:00100000:1.0:1784584810.245752:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549083136 00000100:00100000:1.0:1784584810.245832:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:1.0:1784584810.245843:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:10526:x1871272549083136:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784584810.245880:0:5807:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784584810.246084:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:10526:x1871272549083136:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 242us (3500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584810.246092:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00080000:2.0:1784584810.246573:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584810.266593:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584810.266715:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549083392 00000100:00100000:0.0:1784584810.266725:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549083392 00000100:00100000:0.0:1784584810.266785:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:0.0:1784584810.266795:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:10526:x1871272549083392:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584810.266819:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584810.266841:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1892 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2feb expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584810.267595:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584810.267614:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584810.267628:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584810.267639:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784584810.267813:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1892 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2feb expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584810.267833:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2feb expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584810.267842:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584810.267845:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584810.267848:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be400, rc 0) 00000100:00100000:0.0:1784584810.268007:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:10526:x1871272549083392:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 1213us (1424us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1784584810.268015:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 131 00000100:00100000:3.0:1784584810.272497:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584810.272635:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549083520 00000100:00100000:0.0:1784584810.272645:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549083520 00000100:00100000:0.0:1784584810.272730:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1784584810.272740:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:2355:x1871272549083520:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584810.272755:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584810.272790:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2feb expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584810.272808:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584810.272813:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584810.272891:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:2355:x1871272549083520:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 152us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584810.272899:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1784584810.275066:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584810.275166:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549083776 00000100:00100000:3.0:1784584810.275200:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549083776 00000100:00100000:3.0:1784584810.275262:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1784584810.275273:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:10526:x1871272549083776:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784584810.275358:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584810.275541:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584810.275555:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584810.275781:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584810.275790:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584810.275797:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584810.275803:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584810.275808:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584810.275815:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584810.275829:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:3.0:1784584810.275832:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784584810.275836:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584810.275853:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584810.276163:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:10526:x1871272549083776:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 890us (1104us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1784584810.276173:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 132 00000100:00100000:3.0:1784584810.280255:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000040:00080000:0.0:1784584810.282435:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584810.282444:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584810.282997:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1784584810.283007:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784584810.283784:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549084032 00000100:00100000:1.0:1784584810.283796:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549084032 00000100:00100000:1.0:1784584810.283895:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:1.0:1784584810.283906:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:10526:x1871272549084032:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784584810.284133:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:10526:x1871272549084032:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 229us (3955us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1784584810.284142:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1784584810.525187:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784584810.525211:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569011968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584810.525281:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584810.526638:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569011968 00000100:00100000:1.0:1784584810.526650:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569011968 00000100:00100000:1.0:1784584810.526761:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784584810.526776:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1871272569011968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584810.526830:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584810.526916:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1871272569011968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584810.526933:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784584810.526976:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569011968:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784584810.527252:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584810.529281:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569012096:0@lo:400:kworker.0 00000100:00100000:3.0:1784584810.529353:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584810.529523:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569012480:0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.529558:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584810.529602:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569012480 00000100:00100000:1.0:1784584810.529609:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569012480 00000100:00100000:1.0:1784584810.529652:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784584810.529661:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569012480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.529742:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569012480:12345-0@lo:400:kworker.0 Request processed in 82us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584810.529748:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784584810.529812:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569012480:0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.529851:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569012224:0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.529890:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584810.529907:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584810.529912:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569012352:0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.529943:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584810.529973:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569012224 00000100:00100000:1.0:1784584810.529977:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569012224 00000100:00100000:1.0:1784584810.530010:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569012352 00000100:00100000:1.0:1784584810.530014:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569012352 00000100:00100000:1.0:1784584810.530043:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784584810.530049:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569012224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.530093:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569012224:12345-0@lo:400:kworker.0 Request processed in 44us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584810.530113:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1784584810.530127:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1784584810.530133:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569012352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.530158:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569012352:12345-0@lo:400:kworker.0 Request processed in 26us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584810.530164:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1784584810.530178:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584810.530197:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569012352:0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.530207:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569012224:0@lo:400:kworker.0 00000100:00100000:2.0:1784584810.530304:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569012096 00000100:00100000:2.0:1784584810.530308:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569012096 00000100:00100000:2.0:1784584810.530344:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1784584810.530350:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569012096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.539451:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584810.539481:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569012608:0@lo:400:kworker.0 00000100:00100000:1.0:1784584810.539563:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584810.539742:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569012608 00000100:00100000:0.0:1784584810.539750:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569012608 00000100:00100000:0.0:1784584810.539858:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784584810.539867:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569012608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584810.539945:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569012608:12345-0@lo:400:kworker.0 Request processed in 79us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584810.539952:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1784584810.539992:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569012608:0@lo:400:kworker.0 00000100:00100000:2.0:1784584810.540449:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569012096:12345-0@lo:400:kworker.0 Request processed in 10095us (11092us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584810.540460:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1784584810.541025:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584810.541195:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569012096:0@lo:400:kworker.0 00010000:00010000:0.0:1784584810.780355:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584811.462736:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584811.462776:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584811.462821:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584811.462846:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584811.462883:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584811.462909:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549084672 00000100:00100000:2.0:1784584811.462917:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549084672 00000100:00100000:2.0:1784584811.462982:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549084288 00000100:00100000:2.0:1784584811.462985:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549084288 00000100:00100000:2.0:1784584811.463006:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:2.0:1784584811.463015:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549084672:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584811.463099:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549084672:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 83us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584811.463125:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 124 00000100:00100000:2.0:1784584811.463145:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:2.0:1784584811.463153:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:2357:x1871272549084288:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584811.463183:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:2357:x1871272549084288:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584811.463189:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 125 00000100:00100000:2.0:1784584811.463207:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549084416 00000100:00100000:2.0:1784584811.463210:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549084416 00000100:00100000:2.0:1784584811.463231:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549084544 00000100:00100000:2.0:1784584811.463234:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549084544 00000100:00100000:2.0:1784584811.463252:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1784584811.463258:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549084416:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584811.463284:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549084416:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584811.463290:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1784584811.463301:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:2.0:1784584811.463306:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2357:x1871272549084544:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584811.463325:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2357:x1871272549084544:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 19us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584811.463330:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00080000:1.0:1784584811.463612:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784584811.463616:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784584811.463618:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584811.463674:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549084160 00000100:00100000:3.0:1784584811.463679:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549084160 00000100:00100000:3.0:1784584811.463727:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 282 00000100:00100000:3.0:1784584811.463734:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549084160:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584811.463759:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549084160:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584811.463765:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 282 00010000:00010000:3.0:1784584811.806079:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784584812.015358:0:12021:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784584812.015367:0:12021:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784584812.026502:0:12021:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784584812.026512:0:12021:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784584812.221803:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584812.222518:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549084928 00000100:00100000:1.0:1784584812.222529:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549084928 00000100:00100000:1.0:1784584812.222624:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:1.0:1784584812.222638:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:10547:x1871272549084928:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584812.222660:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584812.222711:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff18ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ff2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584812.222838:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff18b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584812.222853:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff18b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584812.222878:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff18b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584812.222891:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784584812.223058:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff18ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ff2 expref: 27 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784584812.223188:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784584812.223491:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff18b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ff2 expref: 26 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584812.223502:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:1.0:1784584812.223505:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784584812.223509:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819a00, rc 0) 00000100:00100000:1.0:1784584812.223615:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:10547:x1871272549084928:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 980us (1821us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1784584812.223623:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 133 00000100:00100000:1.0:1784584812.236377:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584812.239773:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549085056 00000100:00100000:2.0:1784584812.239786:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549085056 00000100:00100000:2.0:1784584812.239856:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:2.0:1784584812.239867:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:10547:x1871272549085056:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1784584812.239940:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.239957:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.239969:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.239996:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.240003:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.240010:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.240015:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584812.240019:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.240026:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.240037:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:2.0:1784584812.240040:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584812.240045:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.240051:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3000/0x787d778cc3ff18c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584812.240151:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:10547:x1871272549085056:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 285us (3782us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584812.240159:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:3.0:1784584812.357632:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584812.357980:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549085184 00000100:00100000:2.0:1784584812.357988:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549085184 00000100:00100000:2.0:1784584812.358046:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1784584812.358056:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549085184:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1784584812.358074:0:8782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584812.358095:0:8782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff18ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb2ff9 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584812.358121:0:8782:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5e9a68, atime: 0x6a5e9a67, ctime: 0x6a5e9a68, blocks: 0xb 00010000:00010000:2.0:1784584812.358139:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=307s v=(0 0) 00010000:00010000:2.0:1784584812.358143:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584812.358603:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff18ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ff9 expref: 7 pid: 8782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.358626:0:8782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff18ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ff9 expref: 7 pid: 8782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584812.358640:0:8782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3000, rc 0) 00000100:00100000:2.0:1784584812.360711:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549085184:12345-192.168.203.52@tcp:101:cat.0 Request processed in 2616us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584812.360731:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1784584812.369141:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584812.369378:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549085312 00000100:00100000:3.0:1784584812.369400:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549085312 00002000:00100000:3.0:1784584812.369449:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff97c7effb4a80 x1871272549085312/t0(0) o3->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:383/0 lens 488/0 e 0 to 0 dl 1784584823 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784584812.369473:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7effb4a80 with x1871272549085312 ext(0->4095) 00002000:00010000:3.0:1784584812.369479:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7effb4a80 00000100:00100000:3.0:1784584812.369515:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1784584812.369525:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549085312:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:3.0:1784584812.369766:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549085312:12345-192.168.203.52@tcp:3:cat.0 Request processed in 242us (634us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784584812.374152:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:3.0:1784584812.374174:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff97c7effb4a80 x1871272549085312/t0(0) o3->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:383/0 lens 488/4536 e 0 to 0 dl 1784584823 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784584812.374187:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7effb4a80 with x1871272549085312 ext(0->4095) 00002000:00010000:3.0:1784584812.374193:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7effb4a80 00000004:00080000:3.0:1784584812.571910:0:6996:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307679215494ns, next at 308679213454ns, rc = 0 00000100:00100000:2.0:1784584812.571937:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569012736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584812.574071:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584812.574225:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569012736 00000100:00100000:2.0:1784584812.574234:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569012736 00000100:00100000:2.0:1784584812.574307:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784584812.574319:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1871272569012736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584812.574359:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584812.574420:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1871272569012736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584812.574427:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1784584812.574592:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584812.574634:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569012736:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1784584812.634617:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1784584812.634651:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1784584812.829641:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584813.856771:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1784584814.194574:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:2.0:1784584814.194601:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1784584814.194621:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1784584814.194652:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c7c5c93180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1784584814.194658:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7efc2cc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c7c5c93480 00000020:00080000:2.0:1784584814.194663:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7efc2ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c7c651dc00 00000004:00080000:2.0:1784584814.194680:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:2.0:1784584814.194832:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569012864:0@lo:2:osp-syn-0-0.0 00000020:00080000:1.0:1784584814.194987:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1784584814.195230:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1784584814.195613:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584814.196057:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569012864 00000100:00100000:3.0:1784584814.196068:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569012864 00000100:00100000:3.0:1784584814.196147:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784584814.196158:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3323:x1871272569012864:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1784584814.196496:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1784584814.196582:0:6607:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1784584814.196587:0:6607:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1784584808 -> 1784584808 00002000:00010000:3.0:1784584814.196590:0:6607:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1784584807 -> 1784584807 00002000:00010000:3.0:1784584814.196593:0:6607:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1784584808 -> 1784584808 00002000:00010000:3.0:1784584814.196612:0:6607:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1784584814.196718:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3323:x1871272569012864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 561us (1107us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1784584814.196728:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:0.0:1784584814.197024:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7effb4000/2, rc 0, transno 4294967312 00000100:00100000:0.0:1784584814.197033:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569012864:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1784584814.211581:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1784584814.211607:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:0.0:1784584814.876324:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584815.645557:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569012992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584815.645626:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584815.646170:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569012992 00000100:00100000:2.0:1784584815.646179:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569012992 00000100:00100000:2.0:1784584815.646237:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784584815.646246:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569012992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584815.646279:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584815.646326:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569012992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584815.646340:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1784584815.646416:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584815.646441:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1784584815.646446:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1784584815.646461:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7c640ca80, transno 4294967304 00000100:00100000:3.0:1784584815.646481:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569012992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584815.647266:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569013248:0@lo:400:kworker.0 00000100:00100000:1.0:1784584815.647319:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584815.647347:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584815.647353:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569013376:0@lo:400:kworker.0 00000100:00100000:1.0:1784584815.647390:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584815.647440:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569013248 00000100:00100000:1.0:1784584815.647446:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569013248 00000100:00100000:1.0:1784584815.647474:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569013376 00000100:00100000:1.0:1784584815.647477:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569013376 00000100:00100000:1.0:1784584815.647504:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784584815.647511:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569013248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584815.647552:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffc8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569013248:12345-0@lo:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584815.647559:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1784584815.647574:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1784584815.647580:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569013376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584815.647604:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569013376:12345-0@lo:400:kworker.0 Request processed in 26us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584815.647611:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1784584815.647627:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584815.647651:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569013376:0@lo:400:kworker.0 00000100:00100000:1.0:1784584815.647660:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569013248:0@lo:400:kworker.0 00000100:00100000:3.0:1784584815.647791:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569013120:0@lo:400:kworker.0 00000100:00100000:3.0:1784584815.647823:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584815.647854:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272569013632:0@lo:400:kworker.0 00000100:00100000:3.0:1784584815.647874:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584815.647892:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584815.647897:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569013504:0@lo:400:kworker.0 00000100:00100000:3.0:1784584815.647918:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584815.647940:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569013504 00000100:00100000:3.0:1784584815.647943:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569013504 00000100:00100000:3.0:1784584815.647967:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784584815.647972:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1871272569013504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584815.648000:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1871272569013504:12345-0@lo:400:kworker.0 Request processed in 28us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584815.648005:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784584815.648027:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1784584815.648038:0:3321:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:3.0:1784584815.648054:0:3321:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97c7effb4000 x1871272569012864/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1784584830 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584815.648064:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569013504:0@lo:400:kworker.0 00000100:00100000:3.0:1784584815.648091:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569013632 00000100:00100000:3.0:1784584815.648094:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569013632 00000100:00100000:3.0:1784584815.648117:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784584815.648122:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272569013632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584815.648149:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3f02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272569013632:12345-0@lo:400:kworker.0 Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584815.648154:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:3.0:1784584815.648166:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584815.648179:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272569013632:0@lo:400:kworker.0 00000100:00100000:1.0:1784584815.649172:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569013120 00000100:00100000:1.0:1784584815.649179:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569013120 00000100:00100000:1.0:1784584815.649223:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1784584815.649230:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569013120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584815.649294:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569013120:12345-0@lo:400:kworker.0 Request processed in 64us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584815.649307:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1784584815.649409:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569013120:0@lo:400:kworker.0 00010000:00010000:3.0:1784584815.901124:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584816.579159:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584816.579218:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584816.579241:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549085568 00000100:00100000:2.0:1784584816.579255:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549085568 00000100:00100000:1.0:1784584816.579265:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584816.579299:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584816.579332:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584816.579347:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549085952 00000100:00100000:2.0:1784584816.579354:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549085952 00000100:00100000:2.0:1784584816.579408:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:2.0:1784584816.579427:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2357:x1871272549085568:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584816.579504:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549085824 00000100:00100000:3.0:1784584816.579513:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549085824 00000100:00100000:2.0:1784584816.579531:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2357:x1871272549085568:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 109us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584816.579541:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 129 00000100:00100000:3.0:1784584816.579571:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549085696 00000100:00100000:3.0:1784584816.579577:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549085696 00000100:00100000:2.0:1784584816.579584:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:2.0:1784584816.579597:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549085952:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584816.579616:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1784584816.579634:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549085824:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584816.579636:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549085952:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 36us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584816.579656:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 130 00000100:00100000:3.0:1784584816.579763:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549085824:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 135us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584816.579776:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1784584816.579815:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:3.0:1784584816.579824:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549085696:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584816.579861:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549085696:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 38us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584816.579887:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00080000:3.0:1784584816.579912:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584816.579916:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784584816.579919:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584816.580167:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549085440 00000100:00100000:0.0:1784584816.580189:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549085440 00000100:00100000:0.0:1784584816.580230:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 284 00000100:00100000:0.0:1784584816.580239:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549085440:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584816.580282:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549085440:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 44us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584816.580290:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 284 00010000:00010000:3.0:1784584816.925655:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584817.201484:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584817.205219:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549086080 00000100:00100000:2.0:1784584817.205244:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549086080 00000100:00100000:2.0:1784584817.205366:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:2.0:1784584817.205685:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:10192:x1871272549086080:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1784584817.205875:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:10192:x1871272549086080:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 497us (4404us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584817.205884:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:3.0:1784584817.207607:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584817.208562:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549086336 00000100:00100000:2.0:1784584817.208597:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549086336 00000100:00100000:2.0:1784584817.208668:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:2.0:1784584817.208679:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:10192:x1871272549086336:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784584817.209545:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:10192:x1871272549086336:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 861us (1943us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1784584817.209557:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000040:00080000:3.0:1784584817.436049:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784584817.436062:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784584817.436439:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1784584817.436447:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784584817.560390:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584817.560491:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549086464 00000100:00100000:3.0:1784584817.560505:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549086464 00000100:00100000:3.0:1784584817.560594:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:3.0:1784584817.560607:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:10998:x1871272549086464:12345-192.168.203.52@tcp:101:lsof.0 00010000:00010000:3.0:1784584817.560636:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584817.560665:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff18d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3000 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584817.560790:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584817.560819:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584817.560833:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584817.561086:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784584817.561091:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584817.561200:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584817.561233:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff18d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3000 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584817.561254:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3000 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584817.561263:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:3.0:1784584817.561267:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584817.561271:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec000, rc 0) 00000100:00100000:3.0:1784584817.561365:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+6:10998:x1871272549086464:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 760us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584817.561374:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 136 00000100:00100000:0.0:1784584817.694646:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784584817.694681:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569013760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584817.694827:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584817.696854:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569013760 00000100:00100000:3.0:1784584817.696871:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569013760 00000100:00100000:3.0:1784584817.696965:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784584817.696980:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1871272569013760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584817.697031:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584817.697138:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1871272569013760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (2311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584817.697146:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1784584817.697310:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584817.697435:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569013760:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784584817.948908:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584818.972057:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784584819.295277:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1784584819.295319:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1784584819.295571:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1784584819.295588:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:0.0:1784584819.300158:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1784584819.996039:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584820.765388:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569014272:0@lo:400:kworker.0 00000100:00100000:1.0:1784584820.765489:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584820.765563:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784584820.765570:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569013888:0@lo:400:kworker.0 00000100:00100000:1.0:1784584820.765602:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584820.765625:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569014400:0@lo:400:kworker.0 00000100:00100000:1.0:1784584820.765652:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584820.765709:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569014016:0@lo:400:kworker.0 00000100:00100000:1.0:1784584820.765735:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584820.765750:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569014528:0@lo:400:kworker.0 00000100:00100000:1.0:1784584820.765772:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584820.765789:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584820.765793:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569014144:0@lo:400:kworker.0 00000100:00100000:1.0:1784584820.765815:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584820.767245:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569014272 00000100:00100000:3.0:1784584820.767262:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569014272 00000100:00100000:3.0:1784584820.767363:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569014528 00000100:00100000:3.0:1784584820.767383:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569014528 00000100:00100000:3.0:1784584820.767415:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784584820.767426:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569014272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584820.767531:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569014272:12345-0@lo:400:kworker.0 Request processed in 107us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584820.767538:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784584820.767557:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784584820.767563:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569014528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584820.767599:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569014528:12345-0@lo:400:kworker.0 Request processed in 36us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584820.767605:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784584820.767625:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569013888 00000100:00100000:3.0:1784584820.767629:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569013888 00000100:00100000:3.0:1784584820.767656:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1784584820.767662:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272569013888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584820.767723:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272569013888:12345-0@lo:400:kworker.0 Request processed in 61us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584820.767730:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1784584820.767765:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569014400 00000100:00100000:3.0:1784584820.767769:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569014400 00000100:00100000:3.0:1784584820.767796:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569014016 00000100:00100000:3.0:1784584820.767799:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569014016 00000100:00100000:3.0:1784584820.767811:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569014144 00000100:00100000:3.0:1784584820.767813:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569014144 00000100:00100000:3.0:1784584820.767830:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784584820.767836:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272569014400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584820.767870:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272569014400:12345-0@lo:400:kworker.0 Request processed in 34us (2217us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584820.767883:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1784584820.767895:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1784584820.767900:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569014016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584820.768094:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1784584820.768104:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569014144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584820.768145:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569014144:12345-0@lo:400:kworker.0 Request processed in 44us (2328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584820.768152:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1784584820.769160:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569014016:12345-0@lo:400:kworker.0 Request processed in 1251us (3416us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584820.769169:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1784584820.769221:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784584820.769228:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784584820.769231:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584820.769317:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569014144:0@lo:400:kworker.0 00000100:00100000:3.0:1784584820.769344:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faae8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569014016:0@lo:400:kworker.0 00000100:00100000:3.0:1784584820.769359:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569014528:0@lo:400:kworker.0 00000100:00100000:3.0:1784584820.769432:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569013888:0@lo:400:kworker.0 00000100:00100000:3.0:1784584820.769447:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569014400:0@lo:400:kworker.0 00000100:00100000:3.0:1784584820.769461:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1784584820.769467:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7effb4000, transno 4294967312 00000100:00100000:3.0:1784584820.769488:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569014272:0@lo:400:kworker.0 00000100:00100000:1.0:1784584820.771270:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569014656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584820.771363:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584820.771451:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569014656 00000100:00100000:1.0:1784584820.771462:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569014656 00000100:00100000:1.0:1784584820.771523:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784584820.771533:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569014656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584820.771577:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584820.771628:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569014656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584820.771635:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784584820.771687:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff856300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569014656:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1784584821.020139:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784584821.173392:0:12224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:00:19 (1784584819) 00000100:00100000:1.0:1784584821.700452:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584821.700505:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584821.700555:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584821.700573:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549086592 00000100:00100000:2.0:1784584821.700587:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549086592 00000100:00100000:1.0:1784584821.700602:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584821.700654:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 286 00000100:00100000:2.0:1784584821.700666:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549086592:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584821.700821:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549086592:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 155us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584821.700829:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 286 00000100:00100000:0.0:1784584821.700957:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549086848 00000100:00100000:0.0:1784584821.700962:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549086848 00000100:00080000:1.0:1784584821.700997:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584821.701011:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:0.0:1784584821.701020:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549086848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584821.701067:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549086848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 50us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584821.701074:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1784584821.706013:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549086720 00000100:00100000:3.0:1784584821.706034:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549086720 00000100:00100000:3.0:1784584821.706121:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549087104 00000100:00100000:3.0:1784584821.706125:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549087104 00000100:00100000:3.0:1784584821.706159:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:3.0:1784584821.706170:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2355:x1871272549086720:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584821.706311:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2355:x1871272549086720:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 142us (5804us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584821.706320:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 134 00000100:00100000:3.0:1784584821.706348:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:3.0:1784584821.706355:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+6:2354:x1871272549087104:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584821.706382:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+6:2354:x1871272549087104:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (5778us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584821.706388:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 135 00000100:00100000:3.0:1784584821.706478:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584821.706573:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549086976 00000100:00100000:3.0:1784584821.706578:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549086976 00000100:00100000:3.0:1784584821.706610:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1784584821.706619:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549086976:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584821.706649:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549086976:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584821.706655:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00080000:0.0:1784584821.707040:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784584821.707048:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784584822.044267:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584822.772536:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584822.772911:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549087360 00000100:00100000:2.0:1784584822.772924:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549087360 00000100:00100000:2.0:1784584822.773003:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:2.0:1784584822.773015:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:11263:x1871272549087360:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584822.773063:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584822.773091:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff18df lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3007 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.773202:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.773221:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.773235:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.773252:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.773260:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.773276:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774060:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff18f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774079:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff18f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774088:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff18f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584822.774102:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1784584822.774345:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774355:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774362:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774371:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584822.774375:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774384:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774399:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c7c58a0c00) 00010000:00010000:2.0:1784584822.774402:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584822.774407:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774413:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff18e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774427:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774433:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774445:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774460:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584822.774463:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774469:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774478:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97c7c58a0b00) 00010000:00010000:2.0:1784584822.774481:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584822.774484:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.774490:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff18ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.776660:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff18df lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3007 expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.776861:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff18f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3007 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584822.776873:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:2.0:1784584822.776876:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584822.776880:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2e00, rc 0) 00000100:00100000:2.0:1784584822.776977:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:11263:x1871272549087360:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3962us (4453us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1784584822.776987:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 137 00000100:00100000:1.0:1784584822.787222:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584822.787313:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549087488 00000100:00100000:3.0:1784584822.787338:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549087488 00000100:00100000:3.0:1784584822.787419:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:3.0:1784584822.787430:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:11263:x1871272549087488:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1784584822.787593:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2abed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:11263:x1871272549087488:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 165us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584822.787602:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 138 00000100:00100000:1.0:1784584822.805175:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584822.807158:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549087616 00000100:00100000:3.0:1784584822.807178:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549087616 00000100:00100000:3.0:1784584822.807297:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1784584822.807309:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:2354:x1871272549087616:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584822.807342:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584822.807376:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff18f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3007 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584822.807402:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:3.0:1784584822.807408:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584822.807508:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:2354:x1871272549087616:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 201us (2346us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584822.807516:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1784584822.812234:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584822.812263:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569014784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584822.812363:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584822.812770:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569014784 00000100:00100000:1.0:1784584822.812781:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569014784 00000100:00100000:1.0:1784584822.812872:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784584822.812884:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569014784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1784584822.812930:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584822.812999:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569014784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584822.813007:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784584822.813399:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569014784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784584822.813640:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784584823.067968:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784584823.583095:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584823.583108:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584823.583151:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1784584823.583159:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784584824.092644:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784584824.396229:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:3.0:1784584824.799737:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584824.799850:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549087744 00000100:00100000:0.0:1784584824.799860:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549087744 00000100:00100000:0.0:1784584824.799938:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:0.0:1784584824.799949:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:11306:x1871272549087744:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584824.799971:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584824.799991:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1902 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb300e expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800055:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800070:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800091:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800105:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800112:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800119:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800442:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800452:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800470:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800476:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584824.800481:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800489:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800503:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:0.0:1784584824.800506:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584824.800511:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800518:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1909 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800530:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800536:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800541:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800547:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584824.800550:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800578:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800588:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97c7c636f100) 00010000:00010000:0.0:1784584824.800591:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584824.800594:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800601:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1910 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800633:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1902 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb300e expref: 14 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800644:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:0.0:1784584824.800646:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584824.800650:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1902 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb300e expref: 14 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.800660:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf800, rc 0) 00000100:00100000:0.0:1784584824.801099:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:11306:x1871272549087744:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1150us (1368us total) trans 0 rc 301/301 00000100:00100000:0.0:1784584824.801108:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00080000:1.0:1784584824.801226:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584824.818152:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584824.819055:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549088000 00000100:00100000:1.0:1784584824.819066:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549088000 00000100:00100000:0.0:1784584824.819468:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:0.0:1784584824.819481:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:11306:x1871272549088000:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:0.0:1784584824.819544:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584824.819581:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1280 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e47 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.819601:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:0.0:1784584824.819606:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584824.819915:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.819930:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3000 expref: 5 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.819950:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.819985:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3000 expref: 5 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584824.820000:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3000 expref: 5 pid: 5806 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584824.820015:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569014912:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584824.820111:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c3ced300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584824.828378:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa7b100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569014912:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584824.828422:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584824.830836:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584824.831073:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549088128 00000100:00100000:3.0:1784584824.831082:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549088128 00010000:00010000:3.0:1784584824.831139:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3000 expref: 6 pid: 5806 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584824.831178:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00080000:1.0:1784584824.831188:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584824.831189:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec120a06-153f-439e-85c8-b41da9afb57f+6:2354:x1871272549088128:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584824.831205:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584824.831219:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3000 expref: 6 pid: 5806 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.831232:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3000 expref: 6 pid: 5806 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.831255:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff18d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3000 expref: 6 pid: 5806 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.831273:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:3.0:1784584824.831278:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.831286:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.831293:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.831334:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584824.831380:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584824.831390:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584824.831393:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549088128:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 205us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584824.831403:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00010000:00010000:1.0:1784584824.831433:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584824.831443:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584824.831453:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584824.833127:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1784584824.833146:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584824.833155:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584824.833163:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584824.833175:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584824.833180:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584824.833187:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584824.833202:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7d6b88e00) 00010000:00010000:1.0:1784584824.833205:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584824.833209:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584824.833215:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1917 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584824.833232:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006c06cabd reply state 0000000004b43333 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584824.833246:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584824.833440:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:11306:x1871272549088000:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 13958us (15292us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1784584824.833449:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00010000:00010000:2.0:1784584824.838716:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584824.838746:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584824.838753:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584824.838759:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584824.838764:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584824.838771:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584824.838788:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97c7d6b88a00) 00010000:00010000:2.0:1784584824.838791:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584824.838796:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584824.838801:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff191e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584824.943589:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584824.943738:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549088256 00000100:00100000:3.0:1784584824.943748:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549088256 00000100:00100000:3.0:1784584824.943816:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:3.0:1784584824.943827:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:11314:x1871272549088256:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:3.0:1784584824.943860:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584824.943883:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1925 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3015 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.943961:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff192c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.943975:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff192c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.943988:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff192c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584824.944048:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784584824.944053:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584824.944083:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff192c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.944108:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1925 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3015 expref: 15 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.944127:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff192c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3015 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584824.944136:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189cc00) 00010000:00010000:3.0:1784584824.944139:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584824.944142:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaecc00, rc 0) 00000100:00100000:3.0:1784584824.944322:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:11314:x1871272549088256:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 495us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584824.944329:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 141 00000100:00100000:1.0:1784584825.024482:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584825.024584:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549088384 00000100:00100000:0.0:1784584825.024722:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549088384 00000100:00100000:0.0:1784584825.024890:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:0.0:1784584825.024902:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:11320:x1871272549088384:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584825.024924:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584825.024946:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1933 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb301c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025032:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025046:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025057:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025204:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025211:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025218:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025338:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1948 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025347:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025354:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584825.025381:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1784584825.025385:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584825.025405:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1948 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025428:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025435:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025442:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025448:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584825.025453:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025460:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025473:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189cc00) 00010000:00010000:0.0:1784584825.025476:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584825.025481:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025487:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff193a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025500:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025505:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025510:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025522:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584825.025525:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025531:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025540:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff97c7c636f100) 00010000:00010000:0.0:1784584825.025542:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584825.025545:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025551:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1941 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025585:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1933 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb301c expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025647:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1948 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb301c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.025656:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584825.025658:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784584825.025660:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf800, rc 0) 00000100:00100000:0.0:1784584825.025748:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:11320:x1871272549088384:12345-192.168.203.52@tcp:101:bash.0 Request processed in 850us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584825.025884:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 142 00000100:00100000:1.0:1784584825.030803:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584825.031022:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549088640 00000100:00100000:0.0:1784584825.031044:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549088640 00000100:00100000:0.0:1784584825.031219:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:0.0:1784584825.031230:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+15:11320:x1871272549088640:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584825.031251:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584825.031272:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff194f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3023 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.031493:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.031508:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.031520:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.031560:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.031568:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.031575:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784584825.032517:0:6997:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1784584825.032688:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.033863:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.033910:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.033971:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.033978:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.033986:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.033993:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584825.033997:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.034005:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.034017:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584825.034020:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584825.034024:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.034031:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1956 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784584825.034048:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b45f8a9a reply state 000000007ba9ecfe transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584825.034057:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1784584825.034110:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff194f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3023 expref: 18 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.034126:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3023 expref: 17 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.034134:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f600) 00010000:00010000:0.0:1784584825.034136:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584825.034139:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be400, rc 0) 00000100:00100000:0.0:1784584825.034216:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:11320:x1871272549088640:12345-192.168.203.52@tcp:101:bash.0 Request processed in 2987us (3422us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1784584825.034224:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 143 00000100:00100000:3.0:1784584825.040470:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:0.0:1784584825.040947:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.040960:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.040967:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.040974:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584825.040979:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.040986:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.041004:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c636f100) 00010000:00010000:0.0:1784584825.041007:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584825.041027:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.041034:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff195d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584825.041342:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549088768 00000100:00100000:1.0:1784584825.041352:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549088768 00000100:00100000:1.0:1784584825.041433:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1784584825.041444:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549088768:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1784584825.041462:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584825.041489:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb302a expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784584825.041515:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584825.041533:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:1.0:1784584825.041537:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584825.041547:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb302a expref: 6 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.041565:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb302a expref: 6 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.041576:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818200, rc 0) 00000100:00100000:1.0:1784584825.041639:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549088768:12345-192.168.203.52@tcp:101:bash.0 Request processed in 198us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584825.041646:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00080000:0.0:1784584825.042175:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784584825.048882:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584825.050046:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549088896 00000100:00100000:3.0:1784584825.050080:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549088896 00000100:00100000:3.0:1784584825.050194:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:3.0:1784584825.050204:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:11320:x1871272549088896:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1784584825.050222:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584825.050242:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3031 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.050274:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb302a expref: 7 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.050283:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584825.050288:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584825.050294:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.050338:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb302a expref: 7 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.050352:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb302a expref: 7 pid: 6605 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584825.050367:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6608:1871272569015040:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584825.050608:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584825.056503:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6608:1871272569015040:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584825.056544:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.056589:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec000, rc 0) 00000100:00100000:3.0:1784584825.056659:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:11320:x1871272549088896:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6457us (7785us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584825.056669:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:1.0:1784584825.057318:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584825.057639:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549089024 00000100:00100000:3.0:1784584825.057646:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549089024 00010000:00010000:3.0:1784584825.057680:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb302a expref: 7 pid: 6605 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584825.057742:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:3.0:1784584825.058128:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549089024:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584825.058145:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584825.058171:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb302a expref: 7 pid: 6605 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.058186:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb302a expref: 7 pid: 6605 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.058210:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b173e37/0x787d778cc3ff1972 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb302a expref: 7 pid: 6605 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.058225:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584825.058230:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584825.058238:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.058259:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.058297:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584825.058323:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871272569015168:192.168.203.52@tcp:105: 00000100:00100000:3.0:1784584825.058448:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584825.068167:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871272569015168:192.168.203.52@tcp:105: 00010000:00010000:3.0:1784584825.068192:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584825.068406:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584825.068487:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549089280 00000100:00100000:2.0:1784584825.068494:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549089280 00000100:00100000:2.0:1784584825.068536:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:2.0:1784584825.068544:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:11320:x1871272549089280:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:2.0:1784584825.068862:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:11320:x1871272549089280:12345-192.168.203.52@tcp:35:bash.0 Request processed in 317us (455us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1784584825.068870:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:3.0:1784584825.069357:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549089024:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 11604us (12039us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584825.069368:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00010000:00010000:3.0:1784584825.116045:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584825.178200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584825.178460:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549089536 00000100:00100000:1.0:1784584825.178471:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549089536 00000100:00100000:0.0:1784584825.178767:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:0.0:1784584825.178782:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:11330:x1871272549089536:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584825.178977:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584825.179000:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3038 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584825.179177:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1784584825.179286:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1980 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3038 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.179299:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189cc00) 00010000:00010000:0.0:1784584825.179312:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584825.179317:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3038 expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.179330:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be000, rc 0) 00000100:00100000:0.0:1784584825.179509:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:11330:x1871272549089536:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 730us (1316us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1784584825.179517:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:0.0:1784584825.185618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584825.186506:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549089792 00000100:00100000:1.0:1784584825.186519:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549089792 00000100:00100000:1.0:1784584825.186590:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:1.0:1784584825.186601:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:11330:x1871272549089792:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584825.187313:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:11330:x1871272549089792:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 703us (1693us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1784584825.187341:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:1.0:1784584825.310002:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584825.310204:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549089920 00000100:00100000:3.0:1784584825.310216:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549089920 00000100:00100000:3.0:1784584825.310289:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:3.0:1784584825.310310:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:11336:x1871272549089920:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584825.310347:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584825.310377:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff198e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb303f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.310463:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.310501:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.310515:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584825.310591:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1784584825.310595:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584825.310623:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.310656:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff198e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb303f expref: 22 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.310678:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb303f expref: 21 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.310688:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584825.310746:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584825.310751:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec600, rc 0) 00000100:00100000:3.0:1784584825.310942:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:11336:x1871272549089920:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 642us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584825.310951:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:3.0:1784584825.321808:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584825.322142:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549090176 00000100:00100000:1.0:1784584825.322155:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549090176 00000100:00100000:1.0:1784584825.322232:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:1.0:1784584825.322244:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:11336:x1871272549090176:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584825.322271:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584825.322297:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff199c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3046 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.322442:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff19a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.322460:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff19a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.322473:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff19a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584825.322610:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784584825.322824:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818000/0x787d778cc3ff199c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3046 expref: 24 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.323069:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff19a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3046 expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.323078:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f600) 00010000:00010000:1.0:1784584825.323081:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784584825.323103:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819000, rc 0) 00000100:00100000:1.0:1784584825.323187:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:11336:x1871272549090176:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 945us (1392us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1784584825.323196:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 146 00000100:00100000:0.0:1784584825.329410:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584825.330227:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549090432 00000100:00100000:3.0:1784584825.330242:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549090432 00000100:00100000:3.0:1784584825.330582:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:3.0:1784584825.330596:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:11336:x1871272549090432:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584825.330650:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584825.330713:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff19b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb304d expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.330865:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff19b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.330884:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff19b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.330897:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff19b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584825.330912:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784584825.331061:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff19b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb304d expref: 26 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.331082:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff19b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb304d expref: 25 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.331092:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f600) 00010000:00010000:3.0:1784584825.331096:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1784584825.331100:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaeca00, rc 0) 00000100:00100000:3.0:1784584825.331187:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+25:11336:x1871272549090432:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 594us (1792us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1784584825.331194:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 147 00000100:00100000:0.0:1784584825.337928:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584825.338059:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584825.338144:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549090688 00000100:00100000:3.0:1784584825.338158:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549090688 00000100:00100000:3.0:1784584825.338238:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:3.0:1784584825.338257:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2357:x1871272549090688:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1784584825.338339:0:6607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.338363:0:6607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.338373:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584825.338379:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784584825.338383:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.338432:0:6607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.338448:0:6607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 6 pid: 6608 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584825.338465:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7effb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6607:1871272569015296:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584825.338578:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42480 going to sleep for 11 seconds 00000100:00100000:2.0:1784584825.340676:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549090560 00000100:00100000:2.0:1784584825.340711:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549090560 00000100:00100000:2.0:1784584825.340803:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1784584825.340816:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+25:2354:x1871272549090560:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584825.340946:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584825.341079:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff19a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3046 expref: 25 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.341102:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f600) 00010000:00010000:2.0:1784584825.341108:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584825.341184:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7effb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6607:1871272569015296:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584825.341216:0:6607:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584825.341218:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:2354:x1871272549090560:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 404us (3304us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584825.341240:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1784584825.342944:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584825.343019:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549090816 00000100:00100000:2.0:1784584825.343028:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549090816 00002000:00100000:2.0:1784584825.343074:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97c7effb4000 x1871272549090816/t0(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:396/0 lens 504/0 e 0 to 0 dl 1784584836 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784584825.343083:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7effb4000 with x1871272549090816 ext(0->12) 00010000:00010000:2.0:1784584825.343089:0:6611:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 7 pid: 6608 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.343103:0:6611:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 7 pid: 6608 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584825.343109:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97c7effb4000 00000100:00100000:2.0:1784584825.343139:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1784584825.343163:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7effb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549090816:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:2.0:1784584825.343875:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7effb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2355:x1871272549090816:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 708us (933us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1784584825.343886:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00002000:00100000:2.0:1784584825.343895:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff97c7effb4000 x1871272549090816/t4294967305(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:396/0 lens 504/448 e 0 to 0 dl 1784584836 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784584825.343905:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7effb4000 with x1871272549090816 ext(0->12) 00010000:00010000:2.0:1784584825.343912:0:6611:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 9 pid: 6608 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.343927:0:6611:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 9 pid: 6608 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584825.343933:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97c7effb4000 00000100:00100000:0.0:1784584825.346236:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584825.346377:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549090944 00000100:00100000:1.0:1784584825.346389:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549090944 00010000:00010000:1.0:1784584825.346442:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 9 pid: 6608 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584825.346495:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1784584825.346506:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2357:x1871272549090944:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584825.346526:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784584825.346551:0:5790:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784584825.346554:0:5790:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784584824 00002000:00010000:1.0:1784584825.346556:0:5790:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784584824 00002000:00010000:1.0:1784584825.346558:0:5790:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784584824 00010000:00010000:1.0:1784584825.346564:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 9 pid: 6608 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.346580:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 9 pid: 6608 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.346616:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1979 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3031 expref: 9 pid: 6608 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.346637:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584825.346643:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584825.346669:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.346680:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.346777:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584825.347035:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2357:x1871272549090944:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 351us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584825.347046:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00010000:00010000:0.0:1784584825.347062:0:6607:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.347074:0:6607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.347105:0:6607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.347114:0:6607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.347123:0:6607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.347131:0:6607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584825.347136:0:6607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.347145:0:6607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.347158:0:6607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.347180:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000486cd1ae/0x787d778cc3ff19c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584825.347247:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2357:x1871272549090688:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 8993us (9187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584825.347257:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1784584825.349083:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584825.349174:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549091200 00000100:00100000:3.0:1784584825.349200:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549091200 00000100:00100000:3.0:1784584825.349262:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:3.0:1784584825.349274:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f44450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:11336:x1871272549091200:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:3.0:1784584825.349418:0:5809:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff19b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb304d expref: 24 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784584825.349731:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1784584825.349791:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1784584825.350625:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1784584825.350834:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.350854:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3023 expref: 28 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.350866:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.350911:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3023 expref: 28 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.350942:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3023 expref: 28 pid: 6997 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584825.350960:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1871272569015424:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584825.351079:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8016b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1784584825.353566:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d8aadf80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1871272569015424:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584825.353596:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:2.0:1784584825.353605:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584825.354073:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549091328 00000100:00100000:0.0:1784584825.354083:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549091328 00010000:00010000:0.0:1784584825.354136:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3023 expref: 29 pid: 6997 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584825.354180:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:0.0:1784584825.354191:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:2355:x1871272549091328:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584825.354209:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584825.354217:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3023 expref: 29 pid: 6997 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.354230:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3023 expref: 29 pid: 6997 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.354256:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3023 expref: 29 pid: 6997 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.354273:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f600) 00010000:00010000:0.0:1784584825.354296:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.354317:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.354325:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.354409:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584825.354529:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:2355:x1871272549091328:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 339us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584825.354535:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00010000:00010000:3.0:1784584825.356122:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.356150:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784584825.356342:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1784584825.356597:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1784584825.356760:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569015552:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784584825.356845:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584825.356887:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42840 going to sleep for 11 seconds 00000100:00100000:2.0:1784584825.356945:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569015552 00000100:00100000:2.0:1784584825.356954:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569015552 00000100:00100000:2.0:1784584825.357063:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784584825.357073:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1871272569015552:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:0.0:1784584825.357151:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584825.357180:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faae8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1871272569015552:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 108us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584825.357188:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584825.357207:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab2300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569015552:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784584825.358127:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1784584825.358215:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa7b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569015680:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784584825.358270:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584825.358379:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a480 going to sleep for 11 seconds 00000100:00100000:2.0:1784584825.358381:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569015680 00000100:00100000:2.0:1784584825.358388:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569015680 00000100:00100000:2.0:1784584825.358472:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584825.358481:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5809:x1871272569015680:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784584825.358650:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1871272569015680:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 169us (377us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1784584825.358657:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584825.358689:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa7b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569015680:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784584825.358828:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1784584825.358872:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.358883:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.358891:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.358911:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584825.358917:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.358927:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.358946:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f600) 00010000:00010000:0.0:1784584825.358950:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784584825.358956:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.358963:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff19cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784584825.359179:0:5809:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784584825.359389:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1784584825.359403:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 320466710115ns, next at 321466707733ns, rc = 0 00000001:00080000:0.0:1784584825.359410:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1784584825.359440:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f600) 00010000:00010000:0.0:1784584825.359442:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784584825.359448:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff19b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb304d expref: 32 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584825.359602:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f44450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+31:11336:x1871272549091200:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 10331us (10528us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1784584825.359609:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00000020:00080000:0.0:1784584825.359613:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784584825.363001:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584825.363371:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549091456 00000100:00100000:0.0:1784584825.363384:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549091456 00000100:00100000:0.0:1784584825.363485:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:0.0:1784584825.363496:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+31:11336:x1871272549091456:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584825.363527:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584825.363560:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff19d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3054 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.363640:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff19d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3054 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.363657:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff19d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3054 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.363717:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584825.363720:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584825.363724:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf200, rc 0) 00000100:00100000:0.0:1784584825.363803:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff81b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:11336:x1871272549091456:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 308us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584825.363810:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 148 00000100:00100000:3.0:1784584825.367020:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584825.367268:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549091712 00000100:00100000:1.0:1784584825.367282:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549091712 00000100:00100000:1.0:1784584825.367360:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:1.0:1784584825.367372:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:11336:x1871272549091712:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584825.367680:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+33:11336:x1871272549091712:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 310us (673us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1784584825.367689:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1784584825.434666:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584825.434808:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549091968 00000100:00100000:3.0:1784584825.434821:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549091968 00000100:00100000:3.0:1784584825.434892:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:3.0:1784584825.434904:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+33:11346:x1871272549091968:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584825.434941:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584825.434968:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff19db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb305b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584825.435139:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784584825.435324:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff19db lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb305b expref: 35 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.435343:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189cc00) 00010000:00010000:3.0:1784584825.435346:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584825.435352:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff19db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb305b expref: 35 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.435369:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed800, rc 0) 00000100:00100000:3.0:1784584825.435457:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:11346:x1871272549091968:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 554us (805us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1784584825.435638:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:2.0:1784584825.445688:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584825.445912:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549092096 00000100:00100000:1.0:1784584825.445925:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549092096 00000100:00100000:1.0:1784584825.446001:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:1.0:1784584825.446014:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:11346:x1871272549092096:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:1.0:1784584825.446147:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446170:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446194:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446213:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446219:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446226:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446375:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446385:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446393:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584825.446447:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446463:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446470:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446479:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446496:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584825.446501:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446509:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446523:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:1.0:1784584825.446526:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584825.446530:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446537:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff19e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446552:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446559:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446566:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446571:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584825.446573:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446579:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446599:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7d6b88000) 00010000:00010000:1.0:1784584825.446601:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584825.446604:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446611:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff19f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446626:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446632:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446638:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446643:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584825.446646:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446652:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446660:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584825.446663:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584825.446665:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.446671:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff19f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584825.446834:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:11346:x1871272549092096:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 822us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584825.446845:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:2.0:1784584825.449060:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584825.450063:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549092352 00000100:00100000:1.0:1784584825.450080:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549092352 00000100:00100000:1.0:1784584825.450164:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:1.0:1784584825.450177:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:11346:x1871272549092352:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584825.450557:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:11346:x1871272549092352:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 382us (1507us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1784584825.450566:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:2.0:1784584825.502063:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584825.502329:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549092608 00000100:00100000:3.0:1784584825.502341:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549092608 00000100:00100000:3.0:1784584825.502519:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:3.0:1784584825.502531:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:11349:x1871272549092608:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584825.502563:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584825.502589:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff19fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3062 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.502682:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.502740:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.502761:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.502803:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.502811:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.502818:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.502994:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.503004:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.503012:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584825.503023:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784584825.503421:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503432:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503439:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503447:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584825.503452:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503461:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503475:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584825.503478:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584825.503482:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503488:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503502:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503507:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503512:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503526:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaece00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584825.503529:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503536:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503544:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7e189c200) 00010000:00010000:2.0:1784584825.503546:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584825.503549:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503555:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503612:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff19fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3062 expref: 38 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503629:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3062 expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584825.503637:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:2.0:1784584825.503640:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584825.503642:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed600, rc 0) 00000100:00100000:2.0:1784584825.503770:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:11349:x1871272549092608:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1240us (1719us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1784584825.503780:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 151 00000100:00100000:2.0:1784584825.508622:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584825.509318:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549092736 00000100:00100000:1.0:1784584825.509332:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549092736 00000100:00100000:1.0:1784584825.509446:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:1.0:1784584825.509457:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:11349:x1871272549092736:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:1.0:1784584825.509559:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.509581:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.509594:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.509630:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.509636:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.509655:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.509661:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584825.509666:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.509675:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.509733:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584825.509737:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784584825.509742:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.510185:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1a21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584825.510291:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:11349:x1871272549092736:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 833us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584825.510311:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 152 00000100:00100000:2.0:1784584825.515263:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584825.515373:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549092992 00000100:00100000:3.0:1784584825.515387:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549092992 00000100:00100000:3.0:1784584825.515462:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:3.0:1784584825.515474:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:11349:x1871272549092992:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1784584825.515809:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:11349:x1871272549092992:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 337us (558us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1784584825.515819:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:2.0:1784584825.729989:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584825.732062:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549093248 00000100:00100000:0.0:1784584825.732084:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549093248 00000100:00100000:0.0:1784584825.732170:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:0.0:1784584825.732183:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:11380:x1871272549093248:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1784584825.732217:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584825.732245:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1a28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3069 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.732602:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.732621:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.732635:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584825.732649:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784584825.733635:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1a28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3069 expref: 41 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.733664:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3069 expref: 40 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.733674:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584825.733678:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584825.733682:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfe00, rc 0) 00000100:00100000:0.0:1784584825.733995:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:11380:x1871272549093248:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1813us (4016us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1784584825.734006:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 153 00000100:00100000:2.0:1784584825.739515:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584825.739620:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584825.739730:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549093632 00000100:00100000:1.0:1784584825.739743:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549093632 00000100:00100000:1.0:1784584825.739819:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:1.0:1784584825.739830:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:11380:x1871272549093632:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:1.0:1784584825.740180:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+41:11380:x1871272549093632:12345-192.168.203.52@tcp:35:cat.0 Request processed in 351us (558us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1784584825.740190:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1784584825.741109:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549093376 00000100:00100000:3.0:1784584825.741119:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549093376 00000100:00100000:3.0:1784584825.741998:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1784584825.742030:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+41:2355:x1871272549093376:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584825.742053:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584825.742089:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3069 expref: 41 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584825.742114:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:3.0:1784584825.742120:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584825.742191:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:2355:x1871272549093376:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 167us (2690us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584825.742200:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:2.0:1784584825.821155:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584825.821256:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549093888 00000100:00100000:0.0:1784584825.821269:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549093888 00000100:00100000:0.0:1784584825.821354:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:0.0:1784584825.821367:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:11386:x1871272549093888:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:0.0:1784584825.821412:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584825.821433:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784584825.821468:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb303f expref: 40 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.821493:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584825.821499:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584825.821516:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1a3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3070 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.821651:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.821668:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3062 expref: 40 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.821678:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.821780:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3062 expref: 40 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.821796:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3062 expref: 40 pid: 5808 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584825.821813:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569015808:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584825.821936:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5f91e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584825.824020:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa7ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5807:1871272569015808:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584825.824059:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584825.825474:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584825.825795:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549094016 00000100:00100000:0.0:1784584825.825806:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549094016 00010000:00010000:0.0:1784584825.825868:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3062 expref: 41 pid: 5808 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584825.825918:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:0.0:1784584825.825930:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+41:2354:x1871272549094016:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584825.825950:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584825.825959:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3062 expref: 41 pid: 5808 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.825973:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3062 expref: 41 pid: 5808 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.826004:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3062 expref: 41 pid: 5808 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.826024:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584825.826030:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.826043:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.826051:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.826092:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584825.826176:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a81450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:2354:x1871272549094016:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 248us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584825.826185:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00010000:00010000:1.0:1784584825.826312:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.826321:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584825.826344:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1784584825.826558:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1a3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3070 expref: 41 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.826577:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3070 expref: 40 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.826585:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584825.826588:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784584825.826591:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bee00, rc 0) 00000100:00100000:1.0:1784584825.826635:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:11386:x1871272549093888:12345-192.168.203.52@tcp:101:dd.0 Request processed in 5271us (5494us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1784584825.826643:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:2.0:1784584825.837283:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584825.838378:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549094272 00000100:00100000:0.0:1784584825.838396:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549094272 00000100:00100000:0.0:1784584825.838564:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:0.0:1784584825.838577:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:11386:x1871272549094272:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:0.0:1784584825.839002:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.839022:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584825.839036:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584825.839100:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1784584825.839127:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f83c2636 reply state 00000000eace9bf9 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584825.839138:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784584825.839277:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+43:11386:x1871272549094272:12345-192.168.203.52@tcp:36:dd.0 Request processed in 701us (2007us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1784584825.839285:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 155 00000020:00080000:0.0:1784584825.839292:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784584825.854205:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.854229:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.854236:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.854243:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584825.854249:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.854282:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.854319:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584825.854322:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584825.854327:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584825.854334:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1a52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584825.884458:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584825.884458:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569016064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584825.884552:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584825.887591:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569016064 00000100:00100000:3.0:1784584825.887611:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569016064 00000100:00100000:1.0:1784584825.887637:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569016192:0@lo:400:kworker.0 00000100:00100000:2.0:1784584825.887659:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569016320:0@lo:400:kworker.0 00000100:00100000:3.0:1784584825.887684:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784584825.887719:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569016064:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584825.887743:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1784584825.887751:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584825.887804:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2275c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569016064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584825.887813:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784584825.887823:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569016192 00000100:00100000:1.0:1784584825.887827:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569016192 00000100:00100000:1.0:1784584825.887860:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1784584825.887868:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569016192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584825.887918:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569016192:12345-0@lo:400:kworker.0 Request processed in 51us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584825.887924:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1784584825.887981:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569016192:0@lo:400:kworker.0 00000100:00100000:1.0:1784584825.887984:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569016064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584825.888025:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584825.888112:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569015936:0@lo:400:kworker.0 00000100:00100000:2.0:1784584825.888146:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584825.888281:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569015936 00000100:00100000:1.0:1784584825.888286:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569015936 00000100:00100000:1.0:1784584825.888334:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1784584825.888342:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272569015936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584825.888449:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569016320 00000100:00100000:3.0:1784584825.888454:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569016320 00000100:00080000:2.0:1784584825.888566:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584825.888616:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1784584825.888624:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569016320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584825.888753:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3322:x1871272569015936:12345-0@lo:400:kworker.0 Request processed in 411us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584825.888761:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1784584825.888930:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569016320:12345-0@lo:400:kworker.0 Request processed in 307us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584825.888939:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1784584825.888952:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569016576:0@lo:400:kworker.0 00000100:00100000:2.0:1784584825.888986:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584825.889047:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569016576 00000100:00100000:3.0:1784584825.889052:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569016576 00000100:00080000:3.0:1784584825.889072:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584825.889079:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569016320:0@lo:400:kworker.0 00000100:00100000:1.0:1784584825.889094:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569015936:0@lo:400:kworker.0 00000100:00100000:3.0:1784584825.889099:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1784584825.889108:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569016576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584825.889117:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584825.889126:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7faa78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569016448:0@lo:400:kworker.0 00000100:00100000:1.0:1784584825.889162:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584825.889357:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569016576:12345-0@lo:400:kworker.0 Request processed in 246us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584825.889364:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1784584825.890919:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569016448 00000100:00100000:0.0:1784584825.890936:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569016448 00000100:00100000:0.0:1784584825.891012:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784584825.891023:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569016448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584825.891120:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569016448:12345-0@lo:400:kworker.0 Request processed in 100us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584825.891142:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1784584825.891163:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584825.891203:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569016448:0@lo:400:kworker.0 00000100:00100000:2.0:1784584825.892655:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7faa79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569016576:0@lo:400:kworker.0 00000100:00100000:2.0:1784584826.084983:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.085089:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549094400 00000100:00100000:3.0:1784584826.085103:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549094400 00000100:00100000:3.0:1784584826.085268:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 156 00000100:00100000:3.0:1784584826.085281:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+42:11400:x1871272549094400:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:3.0:1784584826.085325:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584826.085354:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3077 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085457:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085476:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085492:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085510:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085519:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085547:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085672:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085685:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3070 expref: 43 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085738:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085796:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3070 expref: 43 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.085814:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3070 expref: 43 pid: 5807 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584826.085839:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569016704:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584826.085975:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42a80 going to sleep for 11 seconds 00000100:00080000:1.0:1784584826.086954:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584826.090072:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.090321:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569016704:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584826.090353:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584826.090588:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549094656 00000100:00100000:1.0:1784584826.090597:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549094656 00000100:00100000:1.0:1784584826.090669:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1784584826.090679:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+44:5567:x1871272549094656:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784584826.091732:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:5567:x1871272549094656:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 1046us (1667us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1784584826.093985:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:0.0:1784584826.095206:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584826.095310:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549094784 00000100:00100000:1.0:1784584826.095323:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549094784 00010000:00010000:1.0:1784584826.095374:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3070 expref: 45 pid: 5807 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584826.095491:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:1.0:1784584826.095502:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:2354:x1871272549094784:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584826.095522:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584826.095531:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3070 expref: 45 pid: 5807 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.095563:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3070 expref: 45 pid: 5807 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.095590:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1a44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3070 expref: 45 pid: 5807 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.095611:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584826.095618:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.095630:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.095639:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.095686:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584826.095812:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+44:2354:x1871272549094784:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 311us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584826.095820:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00010000:00010000:2.0:1784584826.097226:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097238:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584826.097308:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784584826.097314:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584826.097352:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097458:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097473:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097480:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097488:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097495:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584826.097500:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097509:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097526:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584826.097529:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584826.097535:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097542:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1a60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097559:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097565:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097578:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097583:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584826.097587:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097593:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097601:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7e189cb00) 00010000:00010000:2.0:1784584826.097603:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584826.097606:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097611:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1a67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097666:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1a59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3077 expref: 44 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.097683:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3077 expref: 43 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.098120:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:2.0:1784584826.098124:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584826.098126:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaeca00, rc 0) 00000100:00100000:2.0:1784584826.098220:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+43:11400:x1871272549094400:12345-192.168.203.52@tcp:101:stat.0 Request processed in 12940us (13249us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584826.098474:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 156 00010000:00010000:3.0:1784584826.139878:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584826.162629:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584826.162774:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549095040 00000100:00100000:1.0:1784584826.162788:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549095040 00000100:00100000:1.0:1784584826.162879:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 157 00000100:00100000:1.0:1784584826.162891:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+43:11406:x1871272549095040:12345-192.168.203.52@tcp:36:truncate.0 00010000:00010000:1.0:1784584826.162977:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584826.163014:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1a6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3077 expref: 43 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.163074:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584826.163090:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584826.163504:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.163520:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.163623:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784584826.163683:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1784584826.163767:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000077dd0fde reply state 00000000fe21dee8 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584826.163778:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584826.164410:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:11406:x1871272549095040:12345-192.168.203.52@tcp:36:truncate.0 Request processed in 1517us (1792us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1784584826.164419:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 157 00000020:00080000:1.0:1784584826.164426:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784584826.170018:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.170043:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.170052:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.170059:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584826.170065:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.170075:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.170098:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584826.170102:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584826.170108:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.170114:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1a75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584826.308643:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584826.308795:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549095168 00000100:00100000:2.0:1784584826.308810:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549095168 00000100:00100000:2.0:1784584826.308985:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:2.0:1784584826.308998:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+44:11420:x1871272549095168:12345-192.168.203.52@tcp:101:stat.0 00010000:00010000:2.0:1784584826.309034:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584826.309063:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff1a7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb307e expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.309152:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.309170:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.309184:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.309201:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.309209:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.309216:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310105:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310137:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310147:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584826.310199:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1784584826.310205:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584826.310233:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310249:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310260:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310267:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310275:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310282:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2a00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584826.310394:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310406:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310420:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584826.310430:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584826.310436:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310443:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1a83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310462:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310467:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310473:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310477:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584826.310480:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310485:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310492:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584826.310494:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584826.310496:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310501:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1a8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310546:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff1a7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb307e expref: 46 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310573:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb307e expref: 45 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.310581:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:2.0:1784584826.310583:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584826.310586:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2800, rc 0) 00000100:00100000:2.0:1784584826.310686:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:11420:x1871272549095168:12345-192.168.203.52@tcp:101:stat.0 Request processed in 1690us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584826.310732:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 158 00000100:00100000:1.0:1784584826.430430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.431669:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549095424 00000100:00100000:3.0:1784584826.431689:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549095424 00000100:00100000:3.0:1784584826.431894:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:3.0:1784584826.431922:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+45:11430:x1871272549095424:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584826.431953:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584826.431987:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1a98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3085 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584826.432148:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784584826.432311:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1a98 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3085 expref: 47 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.432328:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189cc00) 00010000:00010000:3.0:1784584826.432332:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584826.432337:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1a98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3085 expref: 47 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.432355:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec400, rc 0) 00000100:00100000:3.0:1784584826.432434:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+46:11430:x1871272549095424:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 515us (2019us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1784584826.432443:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:2.0:1784584826.438216:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.438343:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549095680 00000100:00100000:3.0:1784584826.438358:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549095680 00000100:00100000:3.0:1784584826.438434:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1784584826.438447:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c7f45450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+46:11430:x1871272549095680:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1784584826.438872:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c7f45450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:11430:x1871272549095680:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 427us (669us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1784584826.438882:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:0.0:1784584826.508873:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.509023:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549095936 00000100:00100000:3.0:1784584826.509056:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549095936 00000100:00100000:3.0:1784584826.509141:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:3.0:1784584826.509153:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+47:11436:x1871272549095936:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1784584826.509186:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584826.509217:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1aa6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb308c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.509370:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.509388:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb307e expref: 48 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.509398:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.509439:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb307e expref: 48 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.509455:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb307e expref: 48 pid: 6997 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584826.509471:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569016832:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584826.509601:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584826.515865:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569016832:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584826.515908:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584826.521509:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.521624:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549096064 00000100:00100000:3.0:1784584826.521655:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549096064 00010000:00010000:3.0:1784584826.521753:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb307e expref: 49 pid: 6997 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584826.521807:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:3.0:1784584826.521824:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+49:2354:x1871272549096064:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584826.521849:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584826.521989:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb307e expref: 49 pid: 6997 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.522005:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb307e expref: 49 pid: 6997 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.522035:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1a91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb307e expref: 49 pid: 6997 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.522058:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:3.0:1784584826.522064:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.522077:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.522092:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.522125:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584826.522202:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+48:2354:x1871272549096064:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 385us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584826.522223:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00010000:00010000:0.0:1784584826.522494:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.522504:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584826.522527:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1784584826.522906:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1aa6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb308c expref: 49 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.522942:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb308c expref: 48 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.522952:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584826.522955:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784584826.522958:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec000, rc 0) 00000100:00100000:0.0:1784584826.523136:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+48:11436:x1871272549095936:12345-192.168.203.52@tcp:101:bash.0 Request processed in 13984us (14285us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1784584826.523145:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 160 00000100:00100000:0.0:1784584826.527760:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584826.528030:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549096320 00000100:00100000:1.0:1784584826.528107:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549096320 00000100:00100000:1.0:1784584826.528166:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 161 00000100:00100000:1.0:1784584826.528374:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+48:11436:x1871272549096320:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:1.0:1784584826.528959:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.528977:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.529004:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784584826.529128:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1784584826.529152:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000043800340 reply state 000000008062a274 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584826.529162:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584826.529528:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:11436:x1871272549096320:12345-192.168.203.52@tcp:36:bash.0 Request processed in 1158us (1775us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1784584826.529538:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 161 00000020:00080000:1.0:1784584826.529543:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784584826.535586:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.535605:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.535613:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.535618:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584826.535623:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.535631:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.535649:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584826.535652:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584826.535678:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.535685:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1abb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584826.537805:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584826.538064:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549096448 00000100:00100000:2.0:1784584826.538077:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549096448 00000100:00100000:2.0:1784584826.538150:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:2.0:1784584826.538162:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f42c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:11436:x1871272549096448:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1784584826.538194:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584826.538222:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1ac2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3093 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.538346:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.538365:0:6997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb308c expref: 51 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.538374:0:6997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.538446:0:6997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb308c expref: 51 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.538463:0:6997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb308c expref: 51 pid: 5808 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584826.538481:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569016960:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584826.538596:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8016b4240 going to sleep for 11 seconds 00000100:00100000:2.0:1784584826.541817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584826.541935:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549096576 00000100:00100000:0.0:1784584826.541943:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549096576 00010000:00010000:0.0:1784584826.541992:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb308c expref: 52 pid: 5808 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584826.542033:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:0.0:1784584826.542057:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:2354:x1871272549096576:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584826.542073:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584826.542080:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb308c expref: 52 pid: 5808 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.542094:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb308c expref: 52 pid: 5808 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.542116:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584826.542122:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.542131:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.542138:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.542155:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584826.542213:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:2354:x1871272549096576:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 158us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584826.542230:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00010000:00010000:3.0:1784584826.544814:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1aad lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb308c expref: 51 pid: 5808 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584826.544951:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569016960:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584826.544977:0:6997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.544987:0:6997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.544993:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584826.545043:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784584826.545048:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584826.545070:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.545102:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1ac2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3093 expref: 51 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.545118:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3093 expref: 50 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.545126:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:3.0:1784584826.545128:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784584826.545132:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2200, rc 0) 00000100:00100000:3.0:1784584826.545433:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f42c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:11436:x1871272549096448:12345-192.168.203.52@tcp:101:bash.0 Request processed in 7272us (7641us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584826.545451:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 162 00000100:00100000:2.0:1784584826.552557:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.552683:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549096832 00000100:00100000:3.0:1784584826.552733:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549096832 00000100:00100000:2.0:1784584826.553201:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:2.0:1784584826.553215:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:11436:x1871272549096832:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:2.0:1784584826.553656:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:11436:x1871272549096832:12345-192.168.203.52@tcp:35:bash.0 Request processed in 442us (1112us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1784584826.553665:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:1.0:1784584826.620137:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.620308:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549097088 00000100:00100000:3.0:1784584826.620322:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549097088 00000100:00100000:3.0:1784584826.620398:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:3.0:1784584826.620411:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:11446:x1871272549097088:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584826.620448:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584826.620479:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1ad0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb309a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584826.620679:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784584826.621052:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1ad0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb309a expref: 53 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.621070:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189cc00) 00010000:00010000:3.0:1784584826.621073:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584826.621080:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1ad0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb309a expref: 53 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.621099:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec000, rc 0) 00000100:00100000:3.0:1784584826.621231:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:11446:x1871272549097088:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 821us (1109us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1784584826.621239:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 163 00000100:00100000:0.0:1784584826.625022:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.625075:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549097216 00000100:00100000:3.0:1784584826.625088:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549097216 00000100:00100000:3.0:1784584826.625185:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:3.0:1784584826.625196:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:11446:x1871272549097216:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1784584826.625309:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625329:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625344:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625362:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625368:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625374:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625500:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625510:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625518:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584826.625576:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625593:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625607:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625614:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625622:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584826.625627:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625635:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625651:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584826.625654:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584826.625660:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625666:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1ade lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.625685:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.628903:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.628918:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.628925:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaeca00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584826.628954:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.628964:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.628984:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7e189c900) 00010000:00010000:3.0:1784584826.628987:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584826.628992:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.628999:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.629032:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.629038:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.629045:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.629050:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaece00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584826.629053:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.629059:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.629067:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:3.0:1784584826.629069:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584826.629078:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.629085:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1aec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584826.629265:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:11446:x1871272549097216:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 4064us (4250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584826.629277:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 164 00000100:00100000:3.0:1784584826.632392:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584826.632487:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549097472 00000100:00100000:1.0:1784584826.632499:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549097472 00000100:00100000:1.0:1784584826.632575:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1784584826.632587:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:11446:x1871272549097472:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584826.632982:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:11446:x1871272549097472:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 396us (603us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1784584826.632992:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:1.0:1784584826.664976:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584826.665284:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549097728 00000100:00100000:2.0:1784584826.665306:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549097728 00000100:00100000:2.0:1784584826.665383:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:2.0:1784584826.665395:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+53:11449:x1871272549097728:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584826.665427:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584826.665455:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1af3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30a1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.665558:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.665596:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.665609:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.665627:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.665635:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.665642:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666342:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1b08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666354:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666363:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1b08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584826.666376:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784584826.666510:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666518:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666525:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666541:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584826.666546:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666553:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666570:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584826.666573:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584826.666579:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666586:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1afa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666600:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666606:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666612:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666617:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584826.666620:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666625:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666642:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584826.666644:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584826.666647:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.666653:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.667274:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1af3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30a1 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.667304:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1b08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30a1 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.667312:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:2.0:1784584826.667315:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584826.667317:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2c00, rc 0) 00000100:00100000:2.0:1784584826.667400:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:11449:x1871272549097728:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2008us (2437us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1784584826.667410:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 165 00000100:00100000:3.0:1784584826.671110:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.671200:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584826.671541:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549097984 00000100:00100000:1.0:1784584826.671553:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549097984 00000100:00100000:1.0:1784584826.671631:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1784584826.671643:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:2354:x1871272549097984:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584826.671663:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584826.671713:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1b08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30a1 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584826.671749:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584826.671756:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584826.671833:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:2354:x1871272549097984:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 192us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584826.671842:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1784584826.673615:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549097856 00000100:00100000:2.0:1784584826.673632:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549097856 00000100:00100000:2.0:1784584826.673771:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:2.0:1784584826.673782:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:11449:x1871272549097856:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:2.0:1784584826.673894:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.673913:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.673942:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.673977:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.673984:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.673990:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.673996:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584826.674000:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.674008:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.674021:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:2.0:1784584826.674024:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584826.674029:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.674036:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584826.674127:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:11449:x1871272549097856:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 347us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584826.674135:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 166 00000100:00100000:3.0:1784584826.677020:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584826.677192:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549098240 00000100:00100000:1.0:1784584826.677205:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549098240 00000100:00100000:1.0:1784584826.677313:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1784584826.677326:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:11449:x1871272549098240:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584826.677650:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:11449:x1871272549098240:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 326us (969us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1784584826.677659:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1784584826.819006:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584826.819085:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549098368 00000100:00100000:2.0:1784584826.819119:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549098368 00000100:00100000:2.0:1784584826.819202:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 288 00000100:00100000:2.0:1784584826.819215:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549098368:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584826.819334:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2355:x1871272549098368:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 121us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584826.819343:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 288 00000100:00100000:3.0:1784584826.819663:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584826.819876:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549098496 00000100:00100000:0.0:1784584826.819882:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549098496 00000100:00100000:0.0:1784584826.819933:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:0.0:1784584826.819941:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:2355:x1871272549098496:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584826.820000:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:2355:x1871272549098496:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 60us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584826.820015:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 139 00000100:00100000:3.0:1784584826.821415:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.821523:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584826.821580:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549098752 00000100:00100000:0.0:1784584826.821589:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549098752 00000100:00100000:0.0:1784584826.821635:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549098624 00000100:00100000:0.0:1784584826.821639:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549098624 00000100:00100000:0.0:1784584826.821679:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:0.0:1784584826.821687:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c640fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549098752:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584826.821855:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:2.0:1784584826.821866:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c40f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549098624:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584826.826616:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c640fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549098752:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 4909us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584826.826637:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1784584826.826917:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c40f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2354:x1871272549098624:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 5050us (5389us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584826.826927:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00080000:0.0:1784584826.828536:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584826.828856:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.828910:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549098880 00000100:00100000:3.0:1784584826.828923:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549098880 00000100:00100000:3.0:1784584826.828993:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00100000:3.0:1784584826.829005:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549098880:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584826.829161:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+5:2354:x1871272549098880:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 157us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584826.829169:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 140 00000100:00080000:0.0:1784584826.830055:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584826.832223:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584826.833089:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549099136 00000100:00100000:0.0:1784584826.833102:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549099136 00000100:00100000:0.0:1784584826.833195:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:0.0:1784584826.833207:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:11467:x1871272549099136:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:0.0:1784584826.833237:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584826.833265:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1b1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30a8 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.833421:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1b24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.833439:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1b24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.833453:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1b24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584826.833490:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784584826.833669:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1b1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30a8 expref: 58 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.833763:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1b24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30a8 expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584826.833786:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584826.833789:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784584826.833793:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be800, rc 0) 00000100:00100000:0.0:1784584826.833874:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:11467:x1871272549099136:12345-192.168.203.52@tcp:101:cat.0 Request processed in 669us (1665us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1784584826.833884:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 167 00000100:00100000:1.0:1784584826.855459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.855921:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549099264 00000100:00100000:3.0:1784584826.855936:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549099264 00000100:00100000:3.0:1784584826.856081:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:3.0:1784584826.856093:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:11468:x1871272549099264:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584826.856146:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584826.856174:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30af expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.856262:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1b39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.856282:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.856306:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584826.856397:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1784584826.856402:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584826.856433:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.856467:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30af expref: 59 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.856493:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30af expref: 58 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.856503:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584826.856506:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584826.856511:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaeca00, rc 0) 00000100:00100000:3.0:1784584826.856601:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11468:x1871272549099264:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 510us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584826.856608:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 168 00000100:00100000:1.0:1784584826.863135:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584826.863250:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549099648 00000100:00100000:2.0:1784584826.863263:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549099648 00000100:00100000:2.0:1784584826.863393:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1784584826.863406:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11468:x1871272549099648:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1784584826.864162:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11468:x1871272549099648:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 757us (1038us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1784584826.864173:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:0.0:1784584826.867789:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584826.867942:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549099776 00000100:00100000:3.0:1784584826.867958:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549099776 00000100:00100000:3.0:1784584826.868041:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1784584826.868053:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11468:x1871272549099776:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:3.0:1784584826.868073:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784584826.868114:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1ac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3093 expref: 59 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.868143:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1b24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30a8 expref: 58 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.868158:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff19d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3054 expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584826.868176:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:3.0:1784584826.868190:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584826.868329:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:11468:x1871272549099776:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 278us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584826.868339:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1784584826.877631:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584826.881595:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549099904 00000100:00100000:2.0:1784584826.881626:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549099904 00000100:00100000:2.0:1784584826.881811:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:2.0:1784584826.881833:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:11468:x1871272549099904:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:2.0:1784584826.882347:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.882370:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.882394:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584826.882682:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1784584826.882861:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:11468:x1871272549099904:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 1029us (5240us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584826.882871:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 169 00000100:00100000:0.0:1784584826.903196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584826.903323:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549100032 00000100:00100000:2.0:1784584826.903337:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549100032 00000100:00100000:2.0:1784584826.903410:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 170 00000100:00100000:2.0:1784584826.903421:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:11470:x1871272549100032:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584826.903449:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584826.903487:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30b6 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903574:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903592:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903607:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903624:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903630:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903661:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903832:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903842:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903848:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584826.903892:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784584826.903896:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584826.903920:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903934:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903943:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903949:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903955:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903961:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584826.903966:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903981:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.903997:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584826.904000:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584826.904005:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904012:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1b4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904030:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904037:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904044:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904049:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584826.904052:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904058:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904065:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c58a0b00) 00010000:00010000:2.0:1784584826.904068:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584826.904070:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904086:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904127:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30b6 expref: 58 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904141:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30b6 expref: 57 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584826.904149:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584826.904151:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784584826.904153:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2a00, rc 0) 00000100:00100000:2.0:1784584826.904235:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:11470:x1871272549100032:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 815us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584826.904242:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 170 00010000:00010000:0.0:1784584827.168047:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784584827.675997:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784584827.676006:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584827.676301:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1784584827.676318:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784584827.676639:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd94700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569017088:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784584827.676845:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8016b4600 going to sleep for 11 seconds 00000100:00100000:0.0:1784584827.693577:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584827.694494:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549100160 00000100:00100000:3.0:1784584827.694513:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549100160 00000100:00100000:3.0:1784584827.694617:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:3.0:1784584827.694632:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11481:x1871272549100160:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784584827.694673:0:5807:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784584827.694910:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11481:x1871272549100160:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 282us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584827.694937:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 171 00000100:00100000:1.0:1784584827.697766:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd94700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569017088:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784584827.706490:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584827.706550:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549100288 00000100:00100000:3.0:1784584827.706564:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549100288 00000100:00100000:3.0:1784584827.706641:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:3.0:1784584827.706653:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:11481:x1871272549100288:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784584827.706785:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.706809:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.706825:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.706843:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.706851:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.706859:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.706895:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.706905:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.706913:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584827.706975:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784584827.706981:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584827.706998:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.707013:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.707021:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.707029:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.707037:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaece00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584827.707041:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.707050:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708277:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:3.0:1784584827.708295:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584827.708304:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708315:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1b63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708334:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708354:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708362:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708367:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584827.708372:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708379:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708392:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff97c7e189c900) 00010000:00010000:3.0:1784584827.708395:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584827.708398:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708404:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1b6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708426:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708432:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708439:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708444:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584827.708466:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708473:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708482:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:3.0:1784584827.708485:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584827.708488:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.708495:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1b71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584827.713715:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:11481:x1871272549100288:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 7025us (7203us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584827.713738:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 172 00000100:00100000:1.0:1784584827.722459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584827.722586:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549100544 00000100:00100000:3.0:1784584827.722599:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549100544 00000100:00100000:3.0:1784584827.722713:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:3.0:1784584827.722727:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:11481:x1871272549100544:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584827.722754:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584827.722781:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1b78 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30bd expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.722926:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.722946:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.722961:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584827.722976:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1784584827.723116:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.723126:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.723133:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.723141:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584827.723146:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.723155:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.723171:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:3.0:1784584827.723175:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584827.723181:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.723188:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1b7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.723240:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1b78 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30bd expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.723253:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:3.0:1784584827.723255:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584827.723260:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1b78 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30bd expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.723283:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed000, rc 0) 00000100:00100000:3.0:1784584827.723370:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11481:x1871272549100544:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 645us (924us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1784584827.723379:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 173 00000100:00100000:0.0:1784584827.735120:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584827.735211:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549100672 00000100:00100000:2.0:1784584827.735225:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549100672 00000100:00100000:2.0:1784584827.735317:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:2.0:1784584827.735329:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11481:x1871272549100672:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784584827.735406:0:5808:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784584827.735584:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11481:x1871272549100672:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 256us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584827.735593:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 174 00000100:00100000:3.0:1784584827.739794:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584827.740897:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549100928 00000100:00100000:2.0:1784584827.740919:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549100928 00000100:00100000:2.0:1784584827.741012:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:2.0:1784584827.741025:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11481:x1871272549100928:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584827.741053:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584827.741058:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784584827.741094:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1b39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30af expref: 58 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.741116:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584827.741122:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584827.741140:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1b8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30c4 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784584827.742374:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1784584827.744838:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.744868:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.744883:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.745014:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1b8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30c4 expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.745036:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30c4 expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.745046:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c58a0b00) 00010000:00010000:2.0:1784584827.745049:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584827.745053:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3800, rc 0) 00000100:00100000:2.0:1784584827.748653:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11481:x1871272549100928:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 7605us (8842us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1784584827.748673:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 175 00000100:00100000:3.0:1784584827.753177:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584827.754099:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549101184 00000100:00100000:2.0:1784584827.754116:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549101184 00000100:00100000:2.0:1784584827.754201:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:2.0:1784584827.754214:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11481:x1871272549101184:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784584827.754311:0:6997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584827.754351:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1b94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30c4 expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.754371:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c58a0b00) 00010000:00010000:2.0:1784584827.754385:0:6997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584827.754413:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.754432:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.754455:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758045:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758070:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758084:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758176:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758184:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758190:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758196:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584827.758200:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758206:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758218:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584827.758221:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584827.758225:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758247:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ba2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758261:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758266:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758271:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758275:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584827.758278:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758283:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758303:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xdff39ba4 (ffff97c7c58a0d00) 00010000:00010000:2.0:1784584827.758305:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584827.758308:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.758314:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ba9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xdff39ba4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584827.758445:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11481:x1871272549101184:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 4230us (5278us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584827.758453:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 176 00000100:00100000:3.0:1784584827.764991:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584827.765731:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549101312 00000100:00100000:0.0:1784584827.765744:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549101312 00000100:00100000:0.0:1784584827.765809:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:0.0:1784584827.765834:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11481:x1871272549101312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584827.773444:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584827.773484:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30cb expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.773550:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.773564:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.773579:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.773679:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30cb expref: 60 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.773721:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30cb expref: 59 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.773731:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:0.0:1784584827.773734:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784584827.773738:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be000, rc 0) 00000100:00100000:0.0:1784584827.773807:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11481:x1871272549101312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 7976us (8944us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584827.773816:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 177 00000100:00100000:3.0:1784584827.784343:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584827.792417:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549101568 00000100:00100000:2.0:1784584827.792431:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549101568 00000100:00100000:2.0:1784584827.792498:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 178 00000100:00100000:2.0:1784584827.792509:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11481:x1871272549101568:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784584827.792593:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.792609:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.792620:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584827.798629:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1784584827.798651:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 322905958386ns, next at 323905954849ns, rc = 0 00000004:00010000:3.0:1784584827.798834:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f88cbef1 reply state 000000003d7b3069 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584827.798849:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784584827.799012:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11481:x1871272549101568:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 6499us (14676us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1784584827.799023:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 178 00010000:00010000:1.0:1784584827.815626:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584827.815651:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584827.815660:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584827.815668:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584827.815674:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584827.815684:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584827.815766:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:1.0:1784584827.815770:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784584827.815777:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584827.815785:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1bbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584827.815909:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584827.815961:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549101696 00000100:00100000:0.0:1784584827.815975:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549101696 00000100:00100000:0.0:1784584827.816043:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:0.0:1784584827.816066:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:11481:x1871272549101696:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584827.816094:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584827.816118:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30d2 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.816189:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d2 expref: 61 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.816205:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d2 expref: 61 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.816223:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:0.0:1784584827.816226:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584827.816229:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be600, rc 0) 00000100:00100000:0.0:1784584827.816314:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11481:x1871272549101696:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 261us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584827.816321:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 179 00000100:00100000:2.0:1784584827.822078:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584827.822134:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549101824 00000100:00100000:2.0:1784584827.822143:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549101824 00000100:00100000:2.0:1784584827.822203:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:2.0:1784584827.822213:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549101824:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784584827.822598:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549101824:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 384us (540us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1784584827.822608:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:3.0:1784584827.834785:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584827.835386:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549102080 00000100:00100000:1.0:1784584827.835403:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549102080 00000100:00100000:1.0:1784584827.835494:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:1.0:1784584827.835507:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11481:x1871272549102080:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784584827.835976:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+62:11481:x1871272549102080:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 470us (1200us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1784584827.835985:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:3.0:1784584827.846069:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584827.847179:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549102336 00000100:00100000:1.0:1784584827.847192:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549102336 00000100:00100000:1.0:1784584827.847254:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:1.0:1784584827.847265:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+62:11481:x1871272549102336:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784584827.847395:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+62:11481:x1871272549102336:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 132us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584827.847404:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 180 00000100:00100000:3.0:1784584827.853264:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584827.853315:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549102464 00000100:00100000:3.0:1784584827.853325:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549102464 00000100:00100000:3.0:1784584827.853378:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 181 00000100:00100000:3.0:1784584827.853389:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+62:11481:x1871272549102464:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584827.853422:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584827.853443:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1bcc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30d9 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.853509:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1bd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.853523:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.853536:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584827.853574:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584827.853595:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.853621:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1bcc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d9 expref: 64 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.853639:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d9 expref: 63 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.853646:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:3.0:1784584827.853650:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784584827.853653:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed800, rc 0) 00000100:00100000:3.0:1784584827.853723:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+63:11481:x1871272549102464:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 336us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584827.853730:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 181 00000040:00080000:1.0:1784584827.857258:0:12372:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784584827.857267:0:12372:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784584827.857315:0:12372:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1784584827.857321:0:12372:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784584827.859911:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584827.859964:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549102592 00000100:00100000:2.0:1784584827.859975:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549102592 00000100:00100000:2.0:1784584827.860035:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:2.0:1784584827.860046:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549102592:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584827.860075:0:8782:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584827.860119:0:8782:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30e0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584827.860153:0:8782:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e9a7b, blocks: 0x1 00010000:00010000:2.0:1784584827.860168:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=322s v=(0 0) 00010000:00010000:2.0:1784584827.860172:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584827.860180:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e0 expref: 8 pid: 8782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.860193:0:8782:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e0 expref: 8 pid: 8782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.860203:0:8782:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3c00, rc 0) 00000100:00100000:2.0:1784584827.860251:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2355:x1871272549102592:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 209us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584827.860257:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1784584827.866668:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584827.866761:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549102848 00000100:00100000:2.0:1784584827.866771:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549102848 00000100:00100000:2.0:1784584827.866841:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:2.0:1784584827.866852:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+63:11481:x1871272549102848:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784584827.866961:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+63:11481:x1871272549102848:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584827.866969:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 182 00000100:00100000:3.0:1784584827.876416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584827.876499:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549102976 00000100:00100000:2.0:1784584827.876508:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549102976 00000100:00100000:2.0:1784584827.876561:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1784584827.876572:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:11481:x1871272549102976:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584827.876598:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584827.876617:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30e7 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.876652:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e0 expref: 9 pid: 8782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.876661:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584827.876665:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584827.876670:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 9 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.876727:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e0 expref: 9 pid: 8782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584827.876741:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e0 expref: 9 pid: 8782 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584827.876755:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6605:1871272569017216:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584827.876862:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8016b4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584827.880192:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584827.880342:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549103104 00000100:00100000:3.0:1784584827.880352:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549103104 00000100:00100000:0.0:1784584827.880399:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6605:1871272569017216:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584827.880432:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 10 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.880433:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e0 expref: 10 pid: 8782 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584827.880465:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2400, rc 0) 00000100:00100000:3.0:1784584827.880491:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1784584827.880501:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:2354:x1871272549103104:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584827.880516:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784584827.880527:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:11481:x1871272549102976:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3956us (4118us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584827.880536:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00010000:00010000:3.0:1784584827.880540:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e0 expref: 10 pid: 8782 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.880555:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e0 expref: 9 pid: 8782 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.880579:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff1bda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e0 expref: 9 pid: 8782 timeout: 422 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.880593:0:8317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584827.880598:0:8317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584827.880606:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.880616:0:8317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584827.880665:0:8317:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584827.880679:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3cf3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8317:1871272569017344:192.168.203.52@tcp:105: 00000100:00100000:3.0:1784584827.880808:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42840 going to sleep for 11 seconds 00000100:00100000:3.0:1784584827.886309:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3cf3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8317:1871272569017344:192.168.203.52@tcp:105: 00010000:00010000:3.0:1784584827.886334:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584827.886387:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2354:x1871272549103104:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 5886us (6201us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584827.886397:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:3.0:1784584827.894278:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584827.894733:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549103232 00000100:00100000:1.0:1784584827.894743:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549103232 00002000:00100000:1.0:1784584827.894905:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97c7f3cf3480 x1871272549103232/t0(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:398/0 lens 504/0 e 0 to 0 dl 1784584838 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784584827.894917:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7f3cf3480 with x1871272549103232 ext(0->8) 00002000:00010000:1.0:1784584827.894922:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7f3cf3480 00000100:00100000:1.0:1784584827.894951:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1784584827.894960:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2356:x1871272549103232:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784584827.898660:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:2356:x1871272549103232:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 3690us (4381us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1784584827.898675:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00002000:00100000:1.0:1784584827.898687:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff97c7f3cf3480 x1871272549103232/t4294967314(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:398/0 lens 504/448 e 0 to 0 dl 1784584838 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784584827.898904:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7f3cf3480 with x1871272549103232 ext(0->8) 00002000:00010000:1.0:1784584827.898911:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7f3cf3480 00000100:00100000:2.0:1784584827.911673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584827.915347:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549103360 00000100:00100000:3.0:1784584827.915365:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549103360 00000100:00100000:0.0:1784584827.915522:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 183 00000100:00100000:0.0:1784584827.915534:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+63:11481:x1871272549103360:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1784584827.942435:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569017472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584827.942509:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584827.942580:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569017472 00000100:00100000:3.0:1784584827.942587:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569017472 00000100:00080000:0.0:1784584827.942642:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584827.942651:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1784584827.942661:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569017472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584827.942686:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584827.942754:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569017472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584827.942760:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784584827.944792:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3cf2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569017472:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1784584828.002552:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1784584828.002569:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1784584828.006483:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+63:11481:x1871272549103360:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 90938us (94804us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584828.006497:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 183 00000001:00080000:1.0:1784584828.006980:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000004:00080000:1.0:1784584828.007006:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1784584828.007032:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c7c3ced300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1784584828.007036:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7c651bb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c7c3cedd80 00000020:00080000:1.0:1784584828.007040:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7c651b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c7f420f800 00000001:00080000:1.0:1784584828.007067:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1784584828.007117:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1784584828.007173:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:1.0:1784584828.007273:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784584828.007302:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff7a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569017600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784584828.007361:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1784584828.007407:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1784584828.007431:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569017600 00000100:00100000:1.0:1784584828.007438:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569017600 00000100:00100000:1.0:1784584828.007487:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784584828.007495:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569017600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1784584828.007627:0:8782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784584828.007631:0:8782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784584827 00002000:00010000:1.0:1784584828.007633:0:8782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784584828.007636:0:8782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784584827 -> 1784584827 00002000:00010000:1.0:1784584828.007638:0:8782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1784584828.007681:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3323:x1871272569017600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (321us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1784584828.007688:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1784584828.007738:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7ff7a2300/2, rc 0, transno 4294967315 00000100:00100000:3.0:1784584828.007746:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff7a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569017600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784584828.008104:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569017728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1784584828.008150:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584828.008345:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569017728 00000100:00100000:2.0:1784584828.008350:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569017728 00000100:00100000:2.0:1784584828.008398:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784584828.008405:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569017728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1784584828.008422:0:6608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1784584828.008449:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5e9a78, atime: 0x6a5e9a78, ctime: 0x6a5e9a78, blocks: 0xb 00010000:00010000:2.0:1784584828.008456:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.008470:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1784584828.008474:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584828.008480:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.008494:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.008504:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.008512:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.008536:0:6608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584828.008746:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584828.008754:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.008764:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584828.008779:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.008789:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.008807:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.008822:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdee900f/0x787d778cc3ff1be8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.008837:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584828.008839:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584828.008841:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784584828.008979:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584828.009387:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3323:x1871272569017728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 980us (1234us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784584828.009396:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784584828.009516:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1784584828.009522:0:3323:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1784584828.009554:0:3323:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97c7ffd95f80 x1871272569017728/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784584844 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1784584828.009566:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7ffd95f80/2, rc 0, transno 4294967307 00000100:00100000:3.0:1784584828.009571:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569017728:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1784584828.010155:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584828.010198:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549103488 00000100:00100000:3.0:1784584828.010206:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549103488 00000100:00100000:3.0:1784584828.010272:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1784584828.010281:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:2354:x1871272549103488:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00080000:1.0:1784584828.010363:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1784584828.054383:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:0.0:1784584828.054399:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1784584828.054841:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549103488:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 44556us (44683us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584828.054854:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1784584828.061216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584828.061975:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549103744 00000100:00100000:1.0:1784584828.061986:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549103744 00000100:00100000:1.0:1784584828.062053:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00100000:1.0:1784584828.062063:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:11481:x1871272549103744:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784584828.062119:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584828.062153:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1bd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d9 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.062173:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:1.0:1784584828.062179:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584828.062213:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.062226:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.062246:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584828.062524:0:5808:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000085975862 reply state 0000000090b91fec transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584828.062534:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584828.062653:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:11481:x1871272549103744:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 591us (1446us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1784584828.062661:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 184 00000100:00080000:1.0:1784584828.062709:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584828.068226:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584828.068436:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549103872 00000100:00100000:0.0:1784584828.068447:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549103872 00000100:00100000:0.0:1784584828.068503:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1784584828.068518:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549103872:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1784584828.068970:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784584828.068974:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784584827 -> 1784584826 00002000:00010000:0.0:1784584828.068977:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784584824 00002000:00010000:0.0:1784584828.068980:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784584827 -> 1784584826 00002000:00010000:0.0:1784584828.068982:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1784584828.069041:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2355:x1871272549103872:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 524us (826us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784584828.069049:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00010000:00010000:3.0:1784584828.069899:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.069912:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.069919:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.069925:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584828.069930:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.069938:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.069955:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:3.0:1784584828.069966:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584828.069972:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.069979:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1bef lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584828.075982:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584828.076434:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549104128 00000100:00100000:3.0:1784584828.076446:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549104128 00000100:00100000:3.0:1784584828.076502:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:3.0:1784584828.076512:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:11481:x1871272549104128:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784584828.076593:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.076613:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30cb expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.076622:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.076666:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30cb expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.076681:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30cb expref: 18 pid: 5807 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584828.076760:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3cf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569017856:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584828.076852:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584828.086273:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3cf2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569017856:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584828.086322:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584828.089049:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584828.090207:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549104256 00000100:00100000:3.0:1784584828.090222:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549104256 00010000:00010000:3.0:1784584828.090276:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30cb expref: 19 pid: 5807 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584828.090346:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1784584828.090357:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:2354:x1871272549104256:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584828.090372:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584828.090380:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30cb expref: 19 pid: 5807 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.090394:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30cb expref: 19 pid: 5807 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.090420:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1bb7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30cb expref: 19 pid: 5807 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.090437:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:3.0:1784584828.090444:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.090454:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.090463:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.090512:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584828.090582:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:2354:x1871272549104256:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 226us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584828.090591:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00010000:00010000:0.0:1784584828.090741:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.090752:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.090874:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.090882:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.090896:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.090902:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584828.090906:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.090913:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.090923:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:0.0:1784584828.090926:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784584828.090930:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.090935:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1bf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584828.090984:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:11481:x1871272549104128:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 14473us (15011us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784584828.090993:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 185 00000100:00100000:2.0:1784584828.099527:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584828.099756:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549104384 00000100:00100000:1.0:1784584828.099767:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549104384 00000100:00100000:1.0:1784584828.099824:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:1.0:1784584828.099835:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2354:x1871272549104384:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1784584828.099880:0:8782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.099901:0:8782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.099910:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1784584828.099915:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584828.099920:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.099958:0:8782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.099997:0:8782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 8 pid: 6605 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584828.100013:0:8782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff7a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8782:1871272569017984:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584828.100094:0:8782:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c414b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784584828.105836:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584828.105909:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549104512 00000100:00100000:2.0:1784584828.105919:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549104512 00010000:00010000:2.0:1784584828.105961:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 9 pid: 6605 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584828.106003:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1784584828.106017:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2355:x1871272549104512:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584828.106035:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584828.106059:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 9 pid: 6605 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.106076:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 9 pid: 6605 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584828.106097:0:8782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff7a1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8782:1871272569017984:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584828.106104:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1be1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30e7 expref: 9 pid: 6605 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.106122:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584828.106127:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584828.106133:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.106143:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.107556:0:8782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.113070:0:8782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.113091:0:8782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.113129:0:8782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.113138:0:8782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.113146:0:8782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.113175:0:8782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584828.113180:0:8782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.113189:0:8782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.113209:0:8782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.113217:0:8782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c3c7c61/0x787d778cc3ff1bfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584828.113334:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2354:x1871272549104384:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 13495us (13809us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584828.113350:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00010000:00010000:2.0:1784584828.113403:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584828.113633:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549104512:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 7620us (7804us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584828.113643:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:3.0:1784584828.119679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584828.122145:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549104768 00000100:00100000:1.0:1784584828.122158:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549104768 00000100:00100000:1.0:1784584828.122280:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 186 00000100:00100000:1.0:1784584828.122303:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+17:11481:x1871272549104768:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784584828.122387:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.122406:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.122437:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.122646:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.122657:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d2 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.122664:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.122722:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d2 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.122738:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d2 expref: 18 pid: 5806 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584828.122752:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff7a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569018112:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584828.122911:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c414b900 going to sleep for 11 seconds 00000100:00100000:2.0:1784584828.130231:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584828.130326:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549104896 00000100:00100000:1.0:1784584828.130335:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549104896 00010000:00010000:1.0:1784584828.130375:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d2 expref: 19 pid: 5806 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584828.130416:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:1.0:1784584828.130426:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:2354:x1871272549104896:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584828.130440:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584828.130460:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d2 expref: 19 pid: 5806 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.130473:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d2 expref: 19 pid: 5806 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.130495:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:1.0:1784584828.130501:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.130511:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.130518:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584828.130537:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584828.130589:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:2354:x1871272549104896:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 165us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584828.130596:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00010000:00010000:0.0:1784584828.131650:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1bc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30d2 expref: 18 pid: 5806 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584828.131672:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff7a1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569018112:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584828.131753:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.131775:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.131781:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584828.131954:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1784584828.132108:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1784584828.132156:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1784584828.132238:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c1f4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5808:1871272569018240:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784584828.132306:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584828.132340:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c41dd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584828.132359:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569018240 00000100:00100000:3.0:1784584828.132365:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569018240 00000100:00100000:3.0:1784584828.132402:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584828.132409:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1871272569018240:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784584828.132473:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1871272569018240:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584828.132478:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584828.132532:0:5808:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1784584828.132536:0:5808:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7ff7a2300, transno 4294967315 00000100:00100000:0.0:1784584828.132551:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c1f4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5808:1871272569018240:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1784584828.133239:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1784584828.133306:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c1f4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5808:1871272569018368:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1784584828.133340:0:5808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584828.133357:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c41dd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584828.133530:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569018368 00000100:00100000:3.0:1784584828.133536:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569018368 00000100:00100000:3.0:1784584828.133568:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584828.133575:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1871272569018368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1784584828.134148:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1871272569018368:12345-0@lo:1000:mdt00_002.0 Request processed in 571us (804us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1784584828.134157:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1784584828.134271:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c1f4ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5808:1871272569018368:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1784584828.134377:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134388:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134406:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134412:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584828.134416:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134423:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134439:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c636f700) 00010000:00010000:0.0:1784584828.134442:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584828.134446:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134453:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818600/0x787d778cc3ff1c0b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134483:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134490:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134495:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134500:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584828.134503:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134519:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134528:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:0.0:1784584828.134531:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584828.134534:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134540:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1b40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134562:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134576:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30b6 expref: 21 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134585:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134612:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30b6 expref: 21 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.134623:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30b6 expref: 21 pid: 6997 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584828.134632:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c1f4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569018496:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584828.134707:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c41dd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584828.140674:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584828.140922:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c1f4dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569018496:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584828.140967:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584828.141167:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549105024 00000100:00100000:3.0:1784584828.141182:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549105024 00010000:00010000:3.0:1784584828.141221:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30b6 expref: 22 pid: 6997 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584828.141263:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:3.0:1784584828.141290:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:2354:x1871272549105024:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584828.141308:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584828.141316:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30b6 expref: 22 pid: 6997 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.141330:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30b6 expref: 22 pid: 6997 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.141356:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1b5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30b6 expref: 22 pid: 6997 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.141370:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:3.0:1784584828.141375:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.141386:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.141393:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584828.141424:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584828.141487:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:2354:x1871272549105024:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 208us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584828.141495:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00010000:00010000:2.0:1784584828.141619:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141628:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141640:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141647:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141654:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141660:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584828.141664:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141672:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141682:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584828.141685:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584828.141724:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141752:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141764:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141770:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141783:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141788:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584828.141791:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141796:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141804:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c58a0700) 00010000:00010000:2.0:1784584828.141806:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784584828.141818:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.141823:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819600/0x787d778cc3ff1c04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584828.142062:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:11481:x1871272549104768:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 19760us (22391us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1784584828.142070:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 186 00000020:00080000:2.0:1784584828.142080:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784584828.143523:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784584828.143531:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784584828.146562:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1784584828.146585:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784584828.151920:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584828.152162:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549105280 00000100:00100000:2.0:1784584828.152173:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549105280 00000100:00100000:2.0:1784584828.152232:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:2.0:1784584828.152239:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6425850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:11481:x1871272549105280:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784584828.154439:0:5809:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784584828.154563:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1784584828.154637:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.154654:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.154666:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.154675:0:5809:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.154681:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.154688:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584828.154758:0:5809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584828.155113:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584828.155121:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.155129:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584828.155133:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.155140:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.155152:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff97c7c58a0300) 00010000:00010000:0.0:1784584828.155155:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784584828.155160:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.155166:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1c19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584828.155183:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584828.155185:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584828.155186:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584828.155189:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6425850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:11481:x1871272549105280:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 2937us (3267us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1784584828.155199:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000020:00080000:2.0:1784584828.155205:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784584828.188084:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584829.212509:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784584829.705449:0:12426:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784584829.705462:0:12426:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784584829.705506:0:12426:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1784584829.705514:0:12426:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784584829.834000:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584829.834094:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549105536 00000100:00100000:3.0:1784584829.834106:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549105536 00000100:00100000:3.0:1784584829.834178:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:3.0:1784584829.834189:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:11499:x1871272549105536:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584829.834220:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584829.834247:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1c20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30ee expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.834577:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1c27 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.834594:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1c27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.834607:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1c27 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584829.834621:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1784584829.834974:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1c20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30ee expref: 25 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.834996:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1c27 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30ee expref: 24 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.835021:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584829.835024:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784584829.835029:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed000, rc 0) 00000100:00100000:3.0:1784584829.835141:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:11499:x1871272549105536:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 954us (1157us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1784584829.835150:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 187 00000100:00100000:1.0:1784584829.841892:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584829.842017:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549105664 00000100:00100000:3.0:1784584829.842030:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549105664 00000100:00100000:3.0:1784584829.842104:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:3.0:1784584829.842116:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:11499:x1871272549105664:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1784584829.842217:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842239:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842255:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842283:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842292:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842300:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842654:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842664:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842671:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584829.842747:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842762:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842770:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842778:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842785:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584829.842790:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842799:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842814:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584829.842818:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584829.842822:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842836:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1c35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842851:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842858:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842865:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842871:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaece00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584829.842875:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842882:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842890:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7e189c900) 00010000:00010000:3.0:1784584829.842893:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584829.842895:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842902:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1c3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842917:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842924:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842938:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842943:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584829.842946:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842953:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842962:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:3.0:1784584829.842965:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584829.842967:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.842974:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584829.843068:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:11499:x1871272549105664:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 952us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584829.843078:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 188 00000100:00100000:0.0:1784584829.899563:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584829.899627:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549105920 00000100:00100000:0.0:1784584829.899639:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549105920 00000100:00100000:0.0:1784584829.899725:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:0.0:1784584829.899737:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:11502:x1871272549105920:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584829.899783:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584829.899822:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1c4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30f5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.899918:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.899937:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.899953:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.899968:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.899976:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.899983:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900367:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900377:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900385:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584829.900397:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1784584829.900522:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900530:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900537:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900544:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584829.900549:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900557:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900571:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584829.900574:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584829.900579:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900585:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1c51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900597:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900603:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900609:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900613:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584829.900623:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900629:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900637:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c636f700) 00010000:00010000:0.0:1784584829.900640:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584829.900642:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900648:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900728:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1c4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30f5 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900744:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30f5 expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.900751:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584829.900754:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584829.900757:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be000, rc 0) 00000100:00100000:0.0:1784584829.900839:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:11502:x1871272549105920:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1103us (1286us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1784584829.900848:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 189 00000100:00100000:0.0:1784584829.907002:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584829.907052:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549106048 00000100:00100000:0.0:1784584829.907063:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549106048 00000100:00100000:0.0:1784584829.907129:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:0.0:1784584829.907159:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:11502:x1871272549106048:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1784584829.907256:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.907285:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.907298:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.907336:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.907343:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.907350:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.907357:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584829.907361:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.907370:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.907385:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584829.907388:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584829.907393:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.907399:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1c6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584829.907486:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:11502:x1871272549106048:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 330us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584829.907496:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 190 00000100:00100000:0.0:1784584829.910184:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584829.910252:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549106304 00000100:00100000:1.0:1784584829.910264:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549106304 00000100:00100000:1.0:1784584829.910368:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:1.0:1784584829.910379:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:11502:x1871272549106304:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584829.910677:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:11502:x1871272549106304:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 298us (507us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1784584829.910686:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:0.0:1784584829.952880:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584829.953106:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549106560 00000100:00100000:1.0:1784584829.953119:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549106560 00000100:00100000:1.0:1784584829.953196:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:1.0:1784584829.953209:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:11029:x1871272549106560:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1784584829.953243:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584829.953281:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1c74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb30fc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.953420:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.953438:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30f5 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.953449:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.953498:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30f5 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.953515:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30f5 expref: 28 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584829.953532:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ff7a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569018624:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584829.953664:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7f79180 going to sleep for 11 seconds 00000100:00100000:3.0:1784584829.957944:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584829.958221:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549106688 00000100:00100000:0.0:1784584829.958233:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549106688 00010000:00010000:0.0:1784584829.958295:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30f5 expref: 29 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584829.958355:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:0.0:1784584829.958366:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:2355:x1871272549106688:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584829.958385:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584829.958393:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30f5 expref: 29 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.958409:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30f5 expref: 29 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.958438:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584829.958444:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.958456:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.958464:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584829.958508:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584829.958622:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:2355:x1871272549106688:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 257us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584829.958631:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00010000:00010000:1.0:1784584829.959034:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1c5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30f5 expref: 28 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584829.959055:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ff7a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569018624:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584829.959091:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.959103:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.959108:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584829.959132:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1784584829.959335:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819000/0x787d778cc3ff1c74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30fc expref: 29 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.959352:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30fc expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.959360:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584829.959363:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784584829.959365:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818200, rc 0) 00000100:00100000:1.0:1784584829.959396:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:11029:x1871272549106560:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6191us (6532us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1784584829.959403:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 191 00000100:00100000:0.0:1784584829.962244:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584829.962357:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549106944 00000100:00100000:3.0:1784584829.962370:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549106944 00000100:00100000:3.0:1784584829.962437:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 192 00000100:00100000:3.0:1784584829.962449:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:11029:x1871272549106944:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:2.0:1784584829.963527:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584829.963571:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584829.963586:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784584829.963668:0:6997:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1784584829.965934:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000322dce63 reply state 00000000e009ecdd transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584829.965959:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1784584829.966118:0:6997:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1784584829.966410:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:11029:x1871272549106944:12345-192.168.203.52@tcp:36:bash.0 Request processed in 3957us (4171us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1784584829.966421:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 192 00000020:00080000:2.0:1784584829.966428:0:6997:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1784584829.969302:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:1.0:1784584829.969517:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.969532:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.969541:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.969570:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584829.969577:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.969585:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.969606:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:1.0:1784584829.969610:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584829.969616:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584829.969623:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1c89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584829.969921:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549107072 00000100:00100000:3.0:1784584829.969933:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549107072 00000100:00100000:3.0:1784584829.970028:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:3.0:1784584829.970048:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+31:11029:x1871272549107072:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1784584829.970076:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584829.970098:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3103 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.970194:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3103 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.970210:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3103 expref: 32 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584829.970230:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:3.0:1784584829.970233:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584829.970236:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec600, rc 0) 00000100:00100000:3.0:1784584829.970319:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:11029:x1871272549107072:12345-192.168.203.52@tcp:101:bash.0 Request processed in 273us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584829.970327:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 193 00000100:00100000:0.0:1784584829.972512:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584829.972663:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549107200 00000100:00100000:2.0:1784584829.972674:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549107200 00000100:00100000:2.0:1784584829.972770:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:2.0:1784584829.972781:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:11029:x1871272549107200:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1784584829.972813:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584829.972840:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb310a expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584829.972870:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5e9a7a, atime: 0x6a5e9a78, ctime: 0x6a5e9a7a, blocks: 0xb 00010000:00010000:2.0:1784584829.972896:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=325s v=(0 0) 00010000:00010000:2.0:1784584829.972901:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584829.972927:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb310a expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584829.972948:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb310a expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584829.972963:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2200, rc 0) 00000100:00100000:2.0:1784584829.973031:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:11029:x1871272549107200:12345-192.168.203.52@tcp:101:bash.0 Request processed in 251us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584829.973038:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:0.0:1784584829.975267:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584829.975440:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549107328 00000100:00100000:2.0:1784584829.975451:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549107328 00002000:00010000:2.0:1784584829.975501:0:6611:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1784584829.975507:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c6c1f4f100 with x1871272549107328 ext(0->18446744073709551615) 00002000:00010000:2.0:1784584829.975521:0:6611:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c6c1f4f100. 00000100:00100000:2.0:1784584829.975561:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1784584829.975571:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2355:x1871272549107328:12345-192.168.203.52@tcp:10:bash.0 00002000:00010000:2.0:1784584829.976162:0:6611:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1784584829.976167:0:6611:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1784584826 -> 1784584829 00002000:00010000:2.0:1784584829.976170:0:6611:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1784584824 -> 1784584824 00002000:00010000:2.0:1784584829.976172:0:6611:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1784584826 -> 1784584829 00002000:00010000:2.0:1784584829.976175:0:6611:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1784584829.976252:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2355:x1871272549107328:12345-192.168.203.52@tcp:10:bash.0 Request processed in 681us (997us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1784584829.976260:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00002000:00010000:2.0:1784584829.976264:0:6611:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1784584829.976292:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c6c1f4f100 with x1871272549107328 ext(0->18446744073709551615) 00002000:00010000:2.0:1784584829.976297:0:6611:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c6c1f4f100. 00000100:00100000:3.0:1784584830.034089:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.036473:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549107456 00000100:00100000:0.0:1784584830.036494:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549107456 00000100:00100000:0.0:1784584830.036610:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00100000:0.0:1784584830.036623:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:11517:x1871272549107456:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:0.0:1784584830.036771:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.036792:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.036805:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.036822:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.036829:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.036835:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037214:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037225:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037233:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784584830.037300:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037314:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037320:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037328:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037335:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584830.037340:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037348:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037364:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584830.037367:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584830.037372:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037387:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037403:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037408:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037414:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037418:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584830.037421:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037428:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037436:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c636f700) 00010000:00010000:0.0:1784584830.037438:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584830.037441:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037447:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1ca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037463:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037469:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037482:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037487:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bee00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584830.037490:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037496:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037505:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584830.037508:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584830.037511:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.037516:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.037631:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:11517:x1871272549107456:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 1008us (3553us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584830.037641:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 194 00000100:00080000:1.0:1784584830.039385:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584830.075835:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.076077:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549107712 00000100:00100000:0.0:1784584830.076090:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549107712 00000100:00100000:0.0:1784584830.076171:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:0.0:1784584830.076183:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+32:11520:x1871272549107712:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584830.076209:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584830.076237:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3111 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.076366:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.076384:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.076397:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.076415:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.076422:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.076429:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077066:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1cc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077080:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077088:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584830.077100:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784584830.077219:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077228:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077242:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077249:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584830.077254:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077263:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077287:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584830.077290:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584830.077295:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077302:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1cba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077317:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077324:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077331:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077336:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584830.077340:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077355:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077363:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c636f700) 00010000:00010000:0.0:1784584830.077366:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584830.077369:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077375:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1cc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077426:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3111 expref: 35 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077442:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3111 expref: 34 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.077450:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584830.077452:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784584830.077455:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be000, rc 0) 00000100:00100000:0.0:1784584830.077543:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:11520:x1871272549107712:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1360us (1721us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1784584830.077552:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 195 00000100:00100000:3.0:1784584830.087033:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.087199:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549107840 00000100:00100000:0.0:1784584830.087212:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549107840 00000100:00100000:0.0:1784584830.087296:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:0.0:1784584830.087310:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:11520:x1871272549107840:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1784584830.087423:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.087445:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30fc expref: 34 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.087457:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.087503:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30fc expref: 34 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.087520:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30fc expref: 34 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.087536:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c1f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569018752:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584830.087664:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c41dd840 going to sleep for 11 seconds 00000100:00100000:0.0:1784584830.093784:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c1f4ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569018752:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584830.093838:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584830.096409:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.096761:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549108096 00000100:00100000:0.0:1784584830.096773:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549108096 00000100:00100000:0.0:1784584830.098405:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:0.0:1784584830.098431:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:5567:x1871272549108096:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784584830.098865:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+36:5567:x1871272549108096:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 446us (2472us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1784584830.098892:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:3.0:1784584830.101250:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584830.101387:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549108224 00000100:00100000:2.0:1784584830.101400:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549108224 00010000:00010000:2.0:1784584830.101457:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30fc expref: 36 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584830.101508:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:2.0:1784584830.101518:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+36:2355:x1871272549108224:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584830.101538:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584830.101546:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30fc expref: 36 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.101561:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30fc expref: 36 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.101589:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1c7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30fc expref: 36 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.101608:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:2.0:1784584830.101615:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.101626:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.101640:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.101688:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584830.101917:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:2355:x1871272549108224:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 399us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584830.101926:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00010000:00010000:2.0:1784584830.101958:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.101967:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.102007:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.102015:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.102023:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.102030:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bee00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584830.102035:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.102044:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.102054:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:2.0:1784584830.102057:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584830.102060:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.102077:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584830.102119:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:11520:x1871272549107840:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 14814us (15100us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584830.102128:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 196 00000100:00100000:2.0:1784584830.105249:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584830.105502:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549108480 00000100:00100000:1.0:1784584830.105515:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549108480 00000100:00100000:1.0:1784584830.105569:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:1.0:1784584830.105580:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+34:11520:x1871272549108480:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584830.106257:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:11520:x1871272549108480:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 674us (1016us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1784584830.106277:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:3.0:1784584830.203514:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584830.203756:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549108736 00000100:00100000:2.0:1784584830.203769:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549108736 00000100:00100000:2.0:1784584830.203854:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:2.0:1784584830.203875:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+35:11531:x1871272549108736:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:2.0:1784584830.203909:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584830.203936:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1cdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3118 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204030:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204049:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204062:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204079:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204086:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204114:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204545:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1cf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204554:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204561:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584830.204571:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1784584830.204681:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204732:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204742:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204749:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584830.204754:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204764:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204779:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584830.204783:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584830.204796:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204803:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204818:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204825:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204831:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204836:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584830.204840:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204846:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204854:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c58a0800) 00010000:00010000:2.0:1784584830.204856:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584830.204859:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204865:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1ceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204916:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3118 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204944:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3118 expref: 37 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.204952:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:2.0:1784584830.204955:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584830.204958:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3800, rc 0) 00000100:00100000:2.0:1784584830.205048:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:11531:x1871272549108736:12345-192.168.203.52@tcp:101:cat.0 Request processed in 1175us (1547us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1784584830.205057:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 197 00000100:00100000:2.0:1784584830.218418:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.218609:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549108992 00000100:00100000:0.0:1784584830.218623:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549108992 00000100:00100000:0.0:1784584830.219237:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 54 00000100:00100000:0.0:1784584830.219253:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:11531:x1871272549108992:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:0.0:1784584830.220258:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:11531:x1871272549108992:12345-192.168.203.52@tcp:35:cat.0 Request processed in 1004us (1847us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1784584830.220279:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 54 00010000:00010000:3.0:1784584830.236372:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584830.245646:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.245864:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549109248 00000100:00100000:0.0:1784584830.245878:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549109248 00000100:00100000:0.0:1784584830.245957:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 198 00000100:00100000:0.0:1784584830.245969:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:11532:x1871272549109248:12345-192.168.203.52@tcp:36:rm.0 00010000:00010000:0.0:1784584830.246048:0:6997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1784584830.246084:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1cf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3118 expref: 38 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246110:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1cc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3111 expref: 37 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246123:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1c90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3103 expref: 36 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246134:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f100) 00010000:00010000:0.0:1784584830.246146:0:6997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584830.246173:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246204:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246215:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246232:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246239:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246246:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246606:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246615:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.246623:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784584830.247315:0:6997:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1784584830.247327:0:6997:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325354634696ns, next at 326354630916ns, rc = 0 00010000:00010000:0.0:1784584830.247403:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247414:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247434:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247442:0:6997:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247449:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247457:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247478:0:6997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584830.247507:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247515:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247522:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247528:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bfe00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584830.247533:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247541:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247553:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f600) 00010000:00010000:0.0:1784584830.247556:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1784584830.247568:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247575:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d0e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247599:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247606:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247613:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247619:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584830.247622:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247628:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247637:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584830.247640:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584830.247642:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.247649:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784584830.247659:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cefb68c0 reply state 0000000068fe57bd transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.247680:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784584830.247830:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+37:11532:x1871272549109248:12345-192.168.203.52@tcp:36:rm.0 Request processed in 1860us (2195us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1784584830.247840:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 198 00010000:00010000:1.0:1784584830.248183:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584830.248197:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.248214:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584830.248218:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.248225:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.248235:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff97c7c636f600) 00010000:00010000:1.0:1784584830.248238:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784584830.248241:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.248246:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d15 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.248263:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584830.248265:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584830.248267:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584830.251413:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.251437:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.251447:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.251454:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584830.251459:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.251489:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.251510:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c636f700) 00010000:00010000:1.0:1784584830.251513:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584830.251519:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.251526:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d07 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584830.284150:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.285211:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549109504 00000100:00100000:0.0:1784584830.285229:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549109504 00000100:00100000:0.0:1784584830.285328:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:0.0:1784584830.285340:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+36:11538:x1871272549109504:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584830.285372:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584830.285402:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb311f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.285586:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.285605:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.285620:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.285637:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.285645:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.285652:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784584830.289223:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1784584830.289841:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.289862:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.289891:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.290401:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.290411:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.290419:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.290427:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bfe00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584830.290432:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.290440:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.290518:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584830.290521:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584830.290527:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.290533:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1d23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584830.290550:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006484f755 reply state 0000000016f9061d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584830.290561:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1784584830.290616:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1d1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb311f expref: 39 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.290632:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb311f expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.290641:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:3.0:1784584830.290643:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784584830.290646:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaece00, rc 0) 00000100:00100000:3.0:1784584830.292039:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+39:11538:x1871272549109504:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6687us (7887us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1784584830.292052:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 199 00000100:00100000:3.0:1784584830.294101:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.294196:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549109632 00000100:00100000:0.0:1784584830.294208:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549109632 00000100:00100000:0.0:1784584830.294322:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:0.0:1784584830.294336:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2355:x1871272549109632:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584830.294360:0:6607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584830.294386:0:6607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3126 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784584830.294432:0:6607:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784584830.294467:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=325s v=(0 0) 00010000:00010000:0.0:1784584830.294472:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584830.294484:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3126 expref: 6 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.294506:0:6607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3126 expref: 6 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.294522:0:6607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be800, rc 0) 00000100:00100000:0.0:1784584830.294601:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549109632:12345-192.168.203.52@tcp:101:bash.0 Request processed in 269us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584830.294608:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00080000:2.0:1784584830.294803:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784584830.294868:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.294879:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.294887:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.294894:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584830.294900:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.294908:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.294924:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c636f100) 00010000:00010000:1.0:1784584830.294927:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584830.294943:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.294950:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1d2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.297569:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584830.297674:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549109760 00000100:00100000:2.0:1784584830.297686:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549109760 00000100:00100000:2.0:1784584830.297895:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:2.0:1784584830.297907:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:11538:x1871272549109760:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1784584830.297943:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584830.297967:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb312d expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.298007:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3126 expref: 7 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.298018:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584830.298023:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584830.298030:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.298350:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3126 expref: 7 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.298369:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3126 expref: 7 pid: 6607 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584830.298387:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6608:1871272569018880:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584830.301390:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1917300 going to sleep for 11 seconds 00000100:00100000:2.0:1784584830.303578:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd94380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6608:1871272569018880:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584830.303627:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.303655:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3400, rc 0) 00000100:00100000:2.0:1784584830.303982:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:11538:x1871272549109760:12345-192.168.203.52@tcp:101:bash.0 Request processed in 6076us (6424us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584830.303994:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1784584830.306774:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.306935:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549109888 00000100:00100000:0.0:1784584830.306948:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549109888 00010000:00010000:0.0:1784584830.307001:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3126 expref: 7 pid: 6607 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.307170:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:0.0:1784584830.307182:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549109888:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584830.307203:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584830.307233:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3126 expref: 7 pid: 6607 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.307249:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3126 expref: 7 pid: 6607 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.307344:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004637bce/0x787d778cc3ff1d3f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3126 expref: 7 pid: 6607 timeout: 425 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.307364:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584830.307369:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584830.307379:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.307392:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.307442:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.307522:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c1f4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871272569019008:192.168.203.52@tcp:105: 00000100:00100000:0.0:1784584830.307676:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c41dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1784584830.316157:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.316324:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549110144 00000100:00100000:3.0:1784584830.316336:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549110144 00000100:00100000:3.0:1784584830.316410:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:3.0:1784584830.316423:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+38:11538:x1871272549110144:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:0.0:1784584830.318222:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c1f4df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871272569019008:192.168.203.52@tcp:105: 00010000:00010000:0.0:1784584830.318279:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584830.318474:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549109888:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 11291us (11716us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584830.318490:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:3.0:1784584830.321041:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+39:11538:x1871272549110144:12345-192.168.203.52@tcp:35:bash.0 Request processed in 4608us (4951us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1784584830.321057:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 55 00000100:00100000:1.0:1784584830.451992:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.452170:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549110272 00000100:00100000:0.0:1784584830.452184:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549110272 00000100:00100000:0.0:1784584830.452339:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:0.0:1784584830.452355:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+39:11554:x1871272549110272:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584830.452388:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584830.452422:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3134 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.452578:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.452596:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.452610:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584830.452905:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1784584830.452910:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584830.452944:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.452974:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3134 expref: 41 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.452999:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3134 expref: 40 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.453032:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584830.453036:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584830.453040:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be600, rc 0) 00000100:00100000:0.0:1784584830.453180:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:11554:x1871272549110272:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 829us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584830.453188:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 200 00000100:00100000:0.0:1784584830.458329:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584830.458433:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549110528 00000100:00100000:2.0:1784584830.458504:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549110528 00000100:00100000:2.0:1784584830.458611:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:2.0:1784584830.458624:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+40:11554:x1871272549110528:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584830.458651:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584830.458680:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1d5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb313b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.459012:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1d62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.459031:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.459046:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1d62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584830.459060:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784584830.459368:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1d5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb313b expref: 43 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.459393:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1d62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb313b expref: 42 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.459404:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:2.0:1784584830.459408:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584830.459412:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2800, rc 0) 00000100:00100000:2.0:1784584830.459654:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+42:11554:x1871272549110528:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1032us (1406us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1784584830.459663:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 201 00000100:00100000:1.0:1784584830.464230:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584830.464409:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584830.464542:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549110912 00000100:00100000:2.0:1784584830.464555:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549110912 00000100:00100000:2.0:1784584830.464638:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1784584830.464650:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+42:2354:x1871272549110912:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584830.464670:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584830.464981:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1d62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb313b expref: 42 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.465006:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:2.0:1784584830.465013:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584830.465153:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a81850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+41:2354:x1871272549110912:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 503us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584830.465162:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1784584830.466570:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549110784 00000100:00100000:0.0:1784584830.466586:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549110784 00000100:00100000:0.0:1784584830.466723:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:0.0:1784584830.466734:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+41:11554:x1871272549110784:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584830.466762:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584830.466799:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3142 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.466936:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.466954:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.466968:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584830.466982:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1784584830.467598:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3142 expref: 44 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.467647:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3142 expref: 43 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.467658:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:0.0:1784584830.467661:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784584830.467665:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be400, rc 0) 00000100:00100000:0.0:1784584830.467780:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+43:11554:x1871272549110784:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1047us (3563us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1784584830.467788:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 202 00000100:00100000:1.0:1784584830.475844:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.476119:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549111040 00000100:00100000:3.0:1784584830.476132:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549111040 00000100:00100000:3.0:1784584830.476210:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:3.0:1784584830.476221:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+6:2355:x1871272549111040:12345-192.168.203.52@tcp:1:lfs.0 00010000:00010000:3.0:1784584830.476412:0:8782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.476568:0:8782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.476578:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584830.476583:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784584830.476589:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.476635:0:8782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.476651:0:8782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 6 pid: 6608 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584830.476669:0:8782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8782:1871272569019136:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584830.479517:0:8782:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584830.486872:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.486978:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549111168 00000100:00100000:0.0:1784584830.486991:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549111168 00002000:00100000:0.0:1784584830.487057:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97c7ff7a2680 x1871272549111168/t0(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:401/0 lens 504/0 e 0 to 0 dl 1784584841 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784584830.487070:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7ff7a2680 with x1871272549111168 ext(0->8) 00010000:00010000:0.0:1784584830.487092:0:6613:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 7 pid: 6608 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.487112:0:6613:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 7 pid: 6608 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784584830.487121:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97c7ff7a2680 00000100:00100000:0.0:1784584830.487160:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:0.0:1784584830.487171:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549111168:12345-192.168.203.52@tcp:4:lfs.0 00000100:00100000:0.0:1784584830.487840:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2355:x1871272549111168:12345-192.168.203.52@tcp:4:lfs.0 Request processed in 665us (978us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784584830.487854:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00002000:00100000:0.0:1784584830.487863:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff97c7ff7a2680 x1871272549111168/t4294967308(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:401/0 lens 504/448 e 0 to 0 dl 1784584841 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784584830.487873:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7ff7a2680 with x1871272549111168 ext(0->8) 00010000:00010000:0.0:1784584830.487881:0:6613:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 9 pid: 6608 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.487897:0:6613:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 9 pid: 6608 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784584830.487904:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff97c7ff7a2680 00000100:00100000:3.0:1784584830.488407:0:8782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8782:1871272569019136:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584830.488439:0:8782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584830.495362:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584830.495496:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549111296 00000100:00100000:1.0:1784584830.495509:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549111296 00010000:00010000:1.0:1784584830.495562:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 9 pid: 6608 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584830.495613:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1784584830.495625:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2354:x1871272549111296:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584830.495645:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784584830.495672:0:5790:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784584830.495674:0:5790:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784584829 00002000:00010000:1.0:1784584830.495677:0:5790:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784584829 00002000:00010000:1.0:1784584830.495679:0:5790:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784584829 00010000:00010000:1.0:1784584830.495743:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 9 pid: 6608 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.495759:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 9 pid: 6608 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.495799:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c7b7376/0x787d778cc3ff1d46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb312d expref: 9 pid: 6608 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.495820:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584830.495825:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584830.495832:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.495848:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584830.495884:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584830.495955:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2354:x1871272549111296:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 332us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584830.495964:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00010000:00010000:2.0:1784584830.496835:0:8782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.496853:0:8782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.496892:0:8782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.496901:0:8782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.496910:0:8782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.496918:0:8782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584830.496923:0:8782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.496952:0:8782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.496970:0:8782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.496978:0:8782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d837cd6d/0x787d778cc3ff1d85 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584830.497067:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549111040:12345-192.168.203.52@tcp:1:lfs.0 Request processed in 20845us (21234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584830.497318:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:1.0:1784584830.504075:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.504238:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549111552 00000100:00100000:0.0:1784584830.504251:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549111552 00000100:00100000:0.0:1784584830.504342:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 56 00000100:00100000:0.0:1784584830.504354:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6426c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+43:11554:x1871272549111552:12345-192.168.203.52@tcp:35:lfs.0 00000004:00010000:0.0:1784584830.504446:0:5809:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3142 expref: 43 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584830.504871:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1784584830.504920:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1784584830.505763:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1784584830.505842:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.505864:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb311f expref: 47 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.505896:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.505946:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb311f expref: 47 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.505966:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb311f expref: 47 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.505984:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c1f4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1871272569019264:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584830.507195:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c41dd900 going to sleep for 11 seconds 00000100:00100000:1.0:1784584830.508561:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.508863:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549111680 00000100:00100000:3.0:1784584830.508876:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549111680 00010000:00010000:3.0:1784584830.508927:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb311f expref: 48 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584830.509009:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:3.0:1784584830.509021:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+48:2355:x1871272549111680:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584830.509040:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584830.509049:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb311f expref: 48 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.509065:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb311f expref: 48 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.509371:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:3.0:1784584830.509378:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.509390:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.509399:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.509426:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584830.509546:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+48:2355:x1871272549111680:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 526us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584830.509555:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00010000:00010000:0.0:1784584830.509674:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb311f expref: 47 pid: 5806 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.509751:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c1f4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5809:1871272569019264:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584830.509777:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.509804:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.509813:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584830.509971:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1784584830.510393:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1784584830.510525:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c1f4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569019392:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784584830.510613:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584830.510643:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d07229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584830.511012:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569019392 00000100:00100000:2.0:1784584830.511020:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569019392 00000100:00080000:3.0:1784584830.511443:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584830.511529:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584830.511541:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c1f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1871272569019392:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784584830.511657:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c1f4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1871272569019392:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 119us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584830.511666:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784584830.512025:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c1f4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569019392:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784584830.512985:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1784584830.513167:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c1f4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569019520:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784584830.513252:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584830.513941:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d82e2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584830.514098:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569019520 00000100:00100000:2.0:1784584830.514107:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569019520 00000100:00100000:2.0:1784584830.514166:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584830.514176:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1871272569019520:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784584830.514469:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4257800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5809:x1871272569019520:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 294us (1216us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784584830.514487:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1784584830.514760:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c1f4c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5809:1871272569019520:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784584830.514993:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1784584830.515051:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.515065:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.515082:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.515090:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584830.515096:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.515105:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.515124:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:0.0:1784584830.515127:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784584830.515133:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.515153:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1d8c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784584830.515951:0:5809:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784584830.516141:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1784584830.516157:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 325623463538ns, next at 326623460570ns, rc = 0 00000001:00080000:0.0:1784584830.516165:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1784584830.516211:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:0.0:1784584830.516216:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784584830.516226:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1d77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3142 expref: 51 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.516623:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6426c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:11554:x1871272549111552:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 12269us (12561us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1784584830.516635:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 56 00000020:00080000:0.0:1784584830.516642:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784584830.519141:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.519211:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549111808 00000100:00100000:3.0:1784584830.519222:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549111808 00000100:00100000:3.0:1784584830.519337:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:3.0:1784584830.519368:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+50:11554:x1871272549111808:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584830.519400:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584830.519430:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1d93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3149 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.519517:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1d93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3149 expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.519538:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1d93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3149 expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.519561:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584830.519565:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584830.519569:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec400, rc 0) 00000100:00100000:3.0:1784584830.519640:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:11554:x1871272549111808:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 274us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584830.519648:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 203 00000100:00100000:1.0:1784584830.523292:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.523435:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549112064 00000100:00100000:3.0:1784584830.523449:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549112064 00000100:00100000:3.0:1784584830.523519:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:3.0:1784584830.523531:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+51:11554:x1871272549112064:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1784584830.524054:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:11554:x1871272549112064:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 523us (773us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1784584830.524064:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 57 00000100:00100000:0.0:1784584830.620486:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.620811:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549112192 00000100:00100000:3.0:1784584830.620824:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549112192 00000100:00100000:3.0:1784584830.620905:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:3.0:1784584830.620937:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:11564:x1871272549112192:12345-192.168.203.52@tcp:34:lfs.0 00010000:00010000:3.0:1784584830.621218:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621240:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621253:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621278:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621285:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621291:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621421:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621429:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621436:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784584830.621490:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621505:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621520:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621527:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621534:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaece00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584830.621539:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621547:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621562:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584830.621565:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584830.621571:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.621577:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1d9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623144:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623322:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623332:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623340:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584830.623364:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623372:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623391:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7e189c700) 00010000:00010000:3.0:1784584830.623394:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584830.623400:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623406:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1da1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623430:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623436:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623443:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623448:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584830.623452:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623458:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623466:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584830.623468:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584830.623478:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.623484:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1da8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584830.623612:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:11564:x1871272549112192:12345-192.168.203.52@tcp:34:lfs.0 Request processed in 2672us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584830.623624:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 204 00000100:00100000:1.0:1784584830.672057:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584830.674379:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549112448 00000100:00100000:2.0:1784584830.674397:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549112448 00000100:00100000:2.0:1784584830.674485:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:2.0:1784584830.674497:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+52:11567:x1871272549112448:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584830.674524:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584830.674555:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff1daf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3150 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.674650:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.674668:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.674682:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.674737:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.674745:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.674751:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.674914:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1dc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.674945:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.674952:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1dc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584830.674963:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784584830.675088:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675096:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675102:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675109:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584830.675114:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675121:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675135:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584830.675138:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584830.675144:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675150:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1db6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675167:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675183:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675189:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675193:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584830.675197:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675203:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675212:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c58a0800) 00010000:00010000:2.0:1784584830.675215:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584830.675217:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675223:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675281:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff1daf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3150 expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675297:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1dc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3150 expref: 54 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.675306:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:2.0:1784584830.675309:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584830.675317:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2800, rc 0) 00000100:00100000:2.0:1784584830.675422:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:11567:x1871272549112448:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 926us (3377us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1784584830.675433:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 205 00000100:00100000:1.0:1784584830.679687:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.679840:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549112576 00000100:00100000:0.0:1784584830.679853:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549112576 00000100:00100000:0.0:1784584830.679922:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:0.0:1784584830.679933:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:11567:x1871272549112576:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1784584830.680025:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.680045:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.680058:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.680107:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.680116:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.680124:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.680131:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584830.680136:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.680144:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.680160:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584830.680164:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584830.680169:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.680176:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.680263:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:11567:x1871272549112576:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 330us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584830.680279:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 206 00000100:00100000:0.0:1784584830.682291:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584830.682397:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549112832 00000100:00100000:1.0:1784584830.682408:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549112832 00000100:00100000:1.0:1784584830.682477:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1784584830.682487:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+54:11567:x1871272549112832:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:1.0:1784584830.682987:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:11567:x1871272549112832:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 497us (704us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1784584830.682997:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 58 00000100:00100000:1.0:1784584830.786306:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584830.786437:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549113088 00000100:00100000:2.0:1784584830.786450:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549113088 00000100:00100000:2.0:1784584830.786561:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:2.0:1784584830.786574:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+55:11577:x1871272549113088:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:2.0:1784584830.786606:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584830.786609:0:5807:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784584830.786644:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3134 expref: 55 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.786667:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584830.786673:0:5807:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584830.786688:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3157 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.787148:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1de0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.787167:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.787179:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1de0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584830.787192:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1784584830.787365:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1dd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3157 expref: 57 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.787383:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1de0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3157 expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.787391:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584830.787394:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784584830.787397:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec600, rc 0) 00000100:00100000:3.0:1784584830.787472:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:11577:x1871272549113088:12345-192.168.203.52@tcp:101:bash.0 Request processed in 902us (1180us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1784584830.787480:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 207 00000100:00100000:2.0:1784584830.791920:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584830.792182:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549113344 00000100:00100000:0.0:1784584830.792195:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549113344 00000100:00100000:0.0:1784584830.792336:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 208 00000100:00100000:0.0:1784584830.792350:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:11577:x1871272549113344:12345-192.168.203.52@tcp:36:bash.0 00010000:00010000:0.0:1784584830.792449:0:6997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1784584830.792486:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1de0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3157 expref: 56 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.792526:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1dc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3150 expref: 55 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.792539:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584830.792546:0:6997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584830.794258:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.794293:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.794305:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584830.794378:0:6997:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1784584830.794406:0:6997:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000526d8bae reply state 00000000f38cde52 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.794417:0:6997:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784584830.794538:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:11577:x1871272549113344:12345-192.168.203.52@tcp:36:bash.0 Request processed in 2189us (2628us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1784584830.794547:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 208 00000020:00080000:0.0:1784584830.794553:0:6997:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1784584830.797827:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:3.0:1784584830.798153:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.798168:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.798176:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.798182:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584830.798188:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.798197:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.798217:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584830.798221:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584830.798225:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.798232:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be800/0x787d778cc3ff1dee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584830.799808:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549113472 00000100:00100000:0.0:1784584830.799848:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549113472 00000100:00100000:0.0:1784584830.799941:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:0.0:1784584830.799953:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+56:11577:x1871272549113472:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584830.799985:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584830.800024:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1df5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb315e expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.800139:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.800157:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.800171:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584830.800209:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1784584830.800214:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584830.800238:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.800284:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff1df5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb315e expref: 58 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.800305:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb315e expref: 57 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584830.800314:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584830.800318:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584830.800321:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be400, rc 0) 00000100:00100000:0.0:1784584830.800419:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:11577:x1871272549113472:12345-192.168.203.52@tcp:101:bash.0 Request processed in 468us (2604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584830.800427:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 209 00000100:00100000:1.0:1784584830.804523:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.804731:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549113728 00000100:00100000:3.0:1784584830.804743:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549113728 00000100:00100000:3.0:1784584830.804811:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:3.0:1784584830.804823:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+57:11577:x1871272549113728:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1784584830.805385:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11577:x1871272549113728:12345-192.168.203.52@tcp:35:bash.0 Request processed in 562us (871us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1784584830.805394:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 59 00000100:00100000:1.0:1784584830.862776:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.863277:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549113856 00000100:00100000:3.0:1784584830.863290:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549113856 00000100:00100000:3.0:1784584830.863362:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:3.0:1784584830.863375:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+58:11583:x1871272549113856:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584830.863408:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584830.863444:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1e03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3165 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.863528:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1e0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.863544:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.863558:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584830.863637:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1784584830.863653:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584830.863683:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1e0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.863742:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec000/0x787d778cc3ff1e03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3165 expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.863766:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1e0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3165 expref: 59 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.863776:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584830.863779:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584830.863813:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaece00, rc 0) 00000100:00100000:3.0:1784584830.864329:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11583:x1871272549113856:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 955us (1564us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584830.864338:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 210 00000100:00100000:1.0:1784584830.868190:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.868300:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549113984 00000100:00100000:3.0:1784584830.868312:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549113984 00000100:00100000:3.0:1784584830.868429:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:3.0:1784584830.868442:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11583:x1871272549113984:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584830.868472:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584830.868499:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1e11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb316c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868581:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868599:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868611:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868630:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868638:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868657:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868843:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1e26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868883:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868890:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584830.868936:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1784584830.868941:0:5807:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584830.868967:0:5807:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868982:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1e26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868992:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.868999:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869005:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869012:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584830.869017:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869025:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869039:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584830.869042:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584830.869055:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869063:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed800/0x787d778cc3ff1e18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869079:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869086:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869092:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869098:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaeca00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584830.869100:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869106:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869114:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7e189c700) 00010000:00010000:3.0:1784584830.869116:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584830.869119:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869125:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaeca00/0x787d778cc3ff1e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869162:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1e11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb316c expref: 61 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869189:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1e26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb316c expref: 60 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.869197:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584830.869199:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784584830.869202:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec600, rc 0) 00000100:00100000:3.0:1784584830.869294:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:11583:x1871272549113984:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 854us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584830.869303:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 211 00000100:00100000:1.0:1784584830.873412:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584830.873468:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.873544:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549114368 00000100:00100000:3.0:1784584830.873556:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549114368 00000100:00100000:3.0:1784584830.873632:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1784584830.873642:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:2357:x1871272549114368:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584830.873671:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584830.873731:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1e26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb316c expref: 60 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.873752:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584830.873757:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584830.873823:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:2357:x1871272549114368:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 183us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584830.873831:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1784584830.875095:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549114240 00000100:00100000:2.0:1784584830.875111:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549114240 00000100:00100000:2.0:1784584830.875178:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:2.0:1784584830.875188:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11583:x1871272549114240:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584830.875215:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584830.875240:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3173 expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.875381:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.875415:0:6997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb315e expref: 60 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.875425:0:6997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.875468:0:6997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb315e expref: 60 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.875483:0:6997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb315e expref: 60 pid: 6997 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584830.875499:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd94380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569019648:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584830.875678:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35eb840 going to sleep for 11 seconds 00000100:00100000:1.0:1784584830.879356:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.880069:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549114496 00000100:00100000:3.0:1784584830.880084:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549114496 00010000:00010000:3.0:1784584830.880138:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb315e expref: 61 pid: 6997 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584830.880210:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1784584830.880222:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:2355:x1871272549114496:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584830.880242:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584830.880250:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb315e expref: 61 pid: 6997 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.880275:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb315e expref: 61 pid: 6997 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.880304:0:8317:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584830.880311:0:8317:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.880322:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.880330:0:8317:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.880355:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584830.880426:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:2355:x1871272549114496:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 206us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584830.880434:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00010000:00010000:2.0:1784584830.881621:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff1dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb315e expref: 60 pid: 6997 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584830.881936:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd94380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569019648:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584830.881966:0:6997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.881979:0:6997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.881986:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584830.882011:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784584830.882229:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3173 expref: 61 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.882249:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3173 expref: 60 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.882260:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:2.0:1784584830.882263:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784584830.882278:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3400, rc 0) 00000100:00100000:2.0:1784584830.882396:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:11583:x1871272549114240:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 7209us (8998us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1784584830.882405:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 212 00000100:00100000:1.0:1784584830.885633:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.885886:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549114752 00000100:00100000:3.0:1784584830.885898:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549114752 00000100:00100000:3.0:1784584830.886057:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:3.0:1784584830.886069:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:11583:x1871272549114752:12345-192.168.203.52@tcp:103:lfs.0 00010000:00010000:3.0:1784584830.886106:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584830.886136:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1d93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3149 expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.886158:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584830.886162:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584830.886231:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4008700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11583:x1871272549114752:12345-192.168.203.52@tcp:103:lfs.0 Request processed in 164us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584830.886238:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1784584830.888499:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584830.888575:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549114880 00000100:00100000:2.0:1784584830.888586:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549114880 00000100:00100000:2.0:1784584830.888659:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:2.0:1784584830.888670:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11583:x1871272549114880:12345-192.168.203.52@tcp:58:lfs.0 00010000:00010000:2.0:1784584830.889033:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.889055:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584830.889069:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584830.889332:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1784584830.889445:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11583:x1871272549114880:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 775us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584830.889456:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 213 00000100:00100000:2.0:1784584830.892035:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584830.892181:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549115008 00000100:00100000:3.0:1784584830.892194:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549115008 00000100:00100000:3.0:1784584830.892275:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:3.0:1784584830.892288:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+59:11583:x1871272549115008:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584830.892314:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584830.892340:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb317a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.892412:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.892426:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1e49 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb317a expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.892451:0:5808:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.892466:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1e49 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb317a expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.892507:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584830.892511:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584830.892516:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1e49 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb317a expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584830.892525:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec400, rc 0) 00000100:00100000:3.0:1784584830.892601:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:11583:x1871272549115008:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 314us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584830.892608:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 214 00000100:00100000:3.0:1784584831.004074:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569019776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584831.004180:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584831.004424:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569019776 00000100:00100000:2.0:1784584831.004434:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569019776 00000100:00100000:2.0:1784584831.004506:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784584831.004517:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1871272569019776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584831.004550:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584831.005588:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569019904:0@lo:400:kworker.0 00000100:00100000:1.0:1784584831.005662:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584831.005748:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569019904 00000100:00100000:1.0:1784584831.005755:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569019904 00000100:00100000:1.0:1784584831.005805:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784584831.005813:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569019904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584831.005865:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569019904:12345-0@lo:400:kworker.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.005872:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784584831.005954:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569019904:0@lo:400:kworker.0 00000100:00100000:2.0:1784584831.008017:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3320:x1871272569019776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3493us (3829us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.008033:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784584831.008297:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272569020160:0@lo:400:kworker.0 00000100:00100000:0.0:1784584831.008567:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584831.008603:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569020032:0@lo:400:kworker.0 00000100:00100000:1.0:1784584831.008637:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584831.008666:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272569020416:0@lo:400:kworker.0 00000100:00100000:3.0:1784584831.008744:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569019776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584831.008771:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569020288:0@lo:400:kworker.0 00000100:00100000:3.0:1784584831.008863:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584831.008957:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569020288 00000100:00100000:0.0:1784584831.008965:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569020288 00000100:00100000:0.0:1784584831.009199:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1784584831.009213:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569020288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584831.009393:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569020160 00000100:00100000:2.0:1784584831.009399:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569020160 00000100:00100000:1.0:1784584831.009401:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569020032 00000100:00100000:1.0:1784584831.009404:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569020032 00000100:00100000:1.0:1784584831.009435:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784584831.009442:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569020032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584831.009488:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569020032:12345-0@lo:400:kworker.0 Request processed in 41us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.009495:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1784584831.009528:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569020032:0@lo:400:kworker.0 00000100:00100000:1.0:1784584831.009555:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784584831.009561:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272569020160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584831.009597:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272569020160:12345-0@lo:400:kworker.0 Request processed in 36us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.009605:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1784584831.009630:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272569020160:0@lo:400:kworker.0 00000100:00100000:1.0:1784584831.009680:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584831.009724:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569020416 00000100:00100000:1.0:1784584831.009728:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569020416 00000100:00100000:1.0:1784584831.009754:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784584831.009760:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272569020416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584831.009810:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871272569020416:12345-0@lo:400:kworker.0 Request processed in 50us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.009816:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1784584831.009875:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4255880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3321:1871272569020416:0@lo:400:kworker.0 00000100:00100000:0.0:1784584831.010538:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569020288:12345-0@lo:400:kworker.0 Request processed in 1327us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584831.010548:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1784584831.010583:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784584831.010590:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584831.011988:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569020288:0@lo:400:kworker.0 00000040:00080000:3.0:1784584831.196828:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784584831.196841:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784584831.196885:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1784584831.196893:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784584831.197059:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41d1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569020544:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784584831.197205:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584831.201385:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.201497:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549115136 00000100:00100000:1.0:1784584831.201506:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549115136 00000100:00100000:1.0:1784584831.201568:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:1.0:1784584831.201579:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11584:x1871272549115136:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784584831.201612:0:5807:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784584831.201815:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11584:x1871272549115136:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 236us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.201833:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 215 00000100:00100000:3.0:1784584831.201983:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41d1c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569020544:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784584831.207377:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.210086:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549115264 00000100:00100000:2.0:1784584831.210102:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549115264 00000100:00100000:2.0:1784584831.210182:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:2.0:1784584831.210193:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:11584:x1871272549115264:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784584831.210280:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210297:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210312:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210328:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210336:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210359:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210384:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210393:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210401:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584831.210439:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784584831.210443:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584831.210457:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210468:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210475:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210482:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210488:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584831.210492:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210500:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210519:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:2.0:1784584831.210522:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584831.210527:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210533:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210547:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210554:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210560:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210566:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584831.210569:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210575:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210583:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff97c7c58a0800) 00010000:00010000:2.0:1784584831.210585:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584831.210588:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210595:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e57 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210622:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210629:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210635:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210640:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2a00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584831.210643:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210649:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210657:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:2.0:1784584831.210659:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584831.210663:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.210669:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.211635:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:11584:x1871272549115264:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 1435us (4258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.211646:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 216 00000100:00100000:0.0:1784584831.216501:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.218388:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549115520 00000100:00100000:1.0:1784584831.218401:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549115520 00000100:00100000:1.0:1784584831.218522:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:1.0:1784584831.218534:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+60:11584:x1871272549115520:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584831.218555:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584831.218576:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1e65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3181 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.218677:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.218722:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.218734:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584831.218745:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784584831.218890:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.218898:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.218905:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.218912:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584831.218916:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.218924:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.218947:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:1.0:1784584831.218950:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784584831.218955:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.218962:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1e6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.219011:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1e65 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3181 expref: 62 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.219025:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:1.0:1784584831.219027:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784584831.219034:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1e65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3181 expref: 62 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.219057:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818200, rc 0) 00000100:00100000:1.0:1784584831.219130:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11584:x1871272549115520:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 598us (2638us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1784584831.219138:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 217 00000100:00100000:1.0:1784584831.222174:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584831.222271:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549115648 00000100:00100000:3.0:1784584831.222296:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549115648 00000100:00100000:3.0:1784584831.222371:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:3.0:1784584831.222383:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11584:x1871272549115648:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784584831.222434:0:5806:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784584831.222568:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11584:x1871272549115648:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 187us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584831.222577:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 218 00000100:00100000:3.0:1784584831.225672:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.226596:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549115904 00000100:00100000:2.0:1784584831.226611:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549115904 00000100:00100000:2.0:1784584831.226681:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:2.0:1784584831.226751:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11584:x1871272549115904:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584831.226778:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584831.226782:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784584831.226809:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff1e0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3165 expref: 61 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.226833:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584831.226840:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584831.226856:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3188 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784584831.227260:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1784584831.227447:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.227461:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.227471:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.227516:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3188 expref: 63 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.227531:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3188 expref: 62 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.227539:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0800) 00010000:00010000:2.0:1784584831.227542:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584831.227552:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3600, rc 0) 00000100:00100000:2.0:1784584831.227616:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+62:11584:x1871272549115904:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 870us (1956us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1784584831.227623:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 219 00000100:00100000:3.0:1784584831.230418:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.232249:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549116160 00000100:00100000:2.0:1784584831.232273:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549116160 00000100:00100000:2.0:1784584831.232348:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:2.0:1784584831.232358:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+62:11584:x1871272549116160:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784584831.232423:0:6997:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584831.232450:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff1e81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3188 expref: 62 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232471:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0800) 00010000:00010000:2.0:1784584831.232482:0:6997:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584831.232501:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232516:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232525:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232569:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232577:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232584:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232671:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232679:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232686:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232716:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584831.232720:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232727:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232736:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584831.232739:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584831.232742:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232748:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3800/0x787d778cc3ff1e8f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232758:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232772:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232778:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232790:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584831.232793:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232799:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232807:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x53fe642c (ffff97c7c58a0300) 00010000:00010000:2.0:1784584831.232809:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584831.232812:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.232818:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1e96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x53fe642c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.232922:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11584:x1871272549116160:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 564us (2517us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584831.233650:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 220 00000100:00100000:1.0:1784584831.238906:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.241451:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549116288 00000100:00100000:2.0:1784584831.241466:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549116288 00000100:00100000:2.0:1784584831.241533:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:2.0:1784584831.241543:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+61:11584:x1871272549116288:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584831.241564:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584831.241588:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb318f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.241624:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.241655:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.241667:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.241794:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb318f expref: 63 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.241812:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb318f expref: 62 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.241833:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:2.0:1784584831.241836:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784584831.241840:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2c00, rc 0) 00000100:00100000:2.0:1784584831.241918:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+62:11584:x1871272549116288:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 375us (3025us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.241926:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 221 00000100:00100000:1.0:1784584831.250799:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584831.251048:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549116544 00000100:00100000:3.0:1784584831.251064:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549116544 00000100:00100000:3.0:1784584831.251134:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:3.0:1784584831.251145:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+62:11584:x1871272549116544:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784584831.251272:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.251293:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.251308:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584831.251775:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1784584831.251788:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326359095032ns, next at 327359092505ns, rc = 0 00000004:00010000:3.0:1784584831.252248:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e31ff5d6 reply state 00000000a0f49a8a transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584831.252269:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784584831.252406:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+64:11584:x1871272549116544:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1262us (1625us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1784584831.252433:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 222 00000100:00100000:3.0:1784584831.257635:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:1.0:1784584831.257769:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.257787:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549116672 00010000:00010000:1.0:1784584831.257793:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.257803:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549116672 00010000:00010000:1.0:1784584831.257806:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.257815:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584831.257821:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.257830:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.257856:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:1.0:1784584831.257859:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784584831.257875:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.257883:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff1eab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.257899:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 223 00000100:00100000:2.0:1784584831.257916:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+64:11584:x1871272549116672:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584831.257957:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584831.257981:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3196 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.258044:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3196 expref: 64 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.258074:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3196 expref: 64 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.258095:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:2.0:1784584831.258099:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784584831.258102:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2a00, rc 0) 00000100:00100000:2.0:1784584831.258167:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+64:11584:x1871272549116672:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 256us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.258175:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 223 00010000:00010000:3.0:1784584831.261853:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584831.264318:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584831.264394:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549116800 00000100:00100000:0.0:1784584831.264406:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549116800 00000100:00100000:0.0:1784584831.264498:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:0.0:1784584831.264508:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2354:x1871272549116800:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784584831.264947:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:2354:x1871272549116800:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 439us (641us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1784584831.264957:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00080000:2.0:1784584831.265392:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584831.268588:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584831.274232:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549117056 00000100:00100000:0.0:1784584831.274254:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549117056 00000100:00100000:0.0:1784584831.274484:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:0.0:1784584831.274518:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+64:11584:x1871272549117056:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784584831.274973:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+65:11584:x1871272549117056:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 457us (6542us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1784584831.274982:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 60 00000100:00100000:1.0:1784584831.278629:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.278842:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549117312 00000100:00100000:2.0:1784584831.278856:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549117312 00000100:00100000:2.0:1784584831.278920:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:2.0:1784584831.278931:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+65:11584:x1871272549117312:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784584831.279067:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+65:11584:x1871272549117312:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 138us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.279075:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 224 00000100:00100000:1.0:1784584831.285622:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.287034:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549117440 00000100:00100000:2.0:1784584831.287052:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549117440 00000100:00100000:1.0:1784584831.291496:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:1.0:1784584831.291518:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+65:11584:x1871272549117440:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584831.291549:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584831.291582:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1eb9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb319d expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.291681:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1ec0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.291722:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.291737:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584831.291784:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584831.291808:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1ec0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.291841:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819200/0x787d778cc3ff1eb9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb319d expref: 67 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.291862:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1ec0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb319d expref: 66 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.291897:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:1.0:1784584831.291901:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784584831.291906:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818200, rc 0) 00000100:00100000:1.0:1784584831.292009:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+66:11584:x1871272549117440:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 497us (6401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.292017:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 225 00000100:00100000:1.0:1784584831.295843:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.295998:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549117568 00000100:00100000:2.0:1784584831.296010:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549117568 00000100:00100000:2.0:1784584831.296075:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:2.0:1784584831.296085:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+10:2355:x1871272549117568:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584831.296109:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584831.296137:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb31a4 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584831.296191:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e9a7e, blocks: 0x1 00010000:00010000:2.0:1784584831.296217:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1784584831.296222:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584831.296234:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31a4 expref: 11 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.296254:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31a4 expref: 11 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.296281:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3800, rc 0) 00000100:00100000:2.0:1784584831.296353:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+11:2355:x1871272549117568:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 269us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.296361:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:2.0:1784584831.302556:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.302728:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549117824 00000100:00100000:1.0:1784584831.302742:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549117824 00000100:00100000:1.0:1784584831.302818:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:1.0:1784584831.302830:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+66:11584:x1871272549117824:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784584831.303068:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+66:11584:x1871272549117824:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 239us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.303077:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 226 00000100:00100000:1.0:1784584831.311259:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584831.311422:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549117952 00000100:00100000:0.0:1784584831.311435:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549117952 00000100:00100000:0.0:1784584831.311505:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:0.0:1784584831.311517:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+11:11584:x1871272549117952:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584831.311542:0:6607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584831.311567:0:6607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb31ab expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.311618:0:6607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31a4 expref: 12 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.311629:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584831.311634:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584831.311641:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 12 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.311682:0:6607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31a4 expref: 12 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.313767:0:6607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31a4 expref: 12 pid: 6608 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584831.313941:0:6607:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6607:1871272569020672:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584831.314283:0:6607:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c41dd9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584831.317981:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.318646:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549118080 00000100:00100000:2.0:1784584831.318659:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549118080 00010000:00010000:2.0:1784584831.318980:0:8317:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31a4 expref: 13 pid: 6608 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.319126:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1784584831.319140:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2354:x1871272549118080:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584831.319161:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584831.319191:0:8317:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31a4 expref: 13 pid: 6608 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.319233:0:8317:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31a4 expref: 13 pid: 6608 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.319277:0:8317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584831.319282:0:8317:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584831.319293:0:8317:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 13 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.319305:0:8317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 13 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.319353:0:8317:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 13 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.319370:0:8317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd95880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8317:1871272569020800:192.168.203.52@tcp:105: 00000100:00100000:2.0:1784584831.319482:0:8317:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b780 going to sleep for 11 seconds 00010000:00010000:1.0:1784584831.319593:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061b71dc5/0x787d778cc3ff1ec7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31a4 expref: 13 pid: 6608 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584831.319621:0:6607:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6607:1871272569020672:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584831.319659:0:6607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 12 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.319671:0:6607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be200, rc 0) 00000100:00100000:1.0:1784584831.319766:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+12:11584:x1871272549117952:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 8252us (8520us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.319775:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:3.0:1784584831.322991:0:8317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd95880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8317:1871272569020800:192.168.203.52@tcp:105: 00010000:00010000:3.0:1784584831.323028:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584831.323095:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+11:2354:x1871272549118080:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 3957us (5126us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584831.323108:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:3.0:1784584831.324775:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.324911:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549118208 00000100:00100000:2.0:1784584831.324923:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549118208 00002000:00100000:2.0:1784584831.325001:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff97c7c41d0e00 x1871272549118208/t0(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:402/0 lens 504/0 e 0 to 0 dl 1784584842 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784584831.325021:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7c41d0e00 with x1871272549118208 ext(0->12) 00002000:00010000:2.0:1784584831.325027:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7c41d0e00 00000100:00100000:2.0:1784584831.325061:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1784584831.325072:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+11:2354:x1871272549118208:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1784584831.325802:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2354:x1871272549118208:12345-192.168.203.52@tcp:4:lhsmtool_posix.0 Request processed in 726us (1034us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1784584831.325813:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00002000:00100000:2.0:1784584831.325821:0:6611:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff97c7c41d0e00 x1871272549118208/t4294967320(0) o4->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:402/0 lens 504/448 e 0 to 0 dl 1784584842 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784584831.325832:0:6611:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7c41d0e00 with x1871272549118208 ext(0->12) 00002000:00010000:2.0:1784584831.325837:0:6611:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7c41d0e00 00000100:00100000:1.0:1784584831.327844:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584831.327963:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549118336 00000100:00100000:3.0:1784584831.327974:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549118336 00000100:00100000:3.0:1784584831.328043:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:3.0:1784584831.328055:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+66:11584:x1871272549118336:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1784584831.354996:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1784584831.355026:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000100:00100000:3.0:1784584831.355455:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+62:11584:x1871272549118336:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 27392us (27611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584831.355468:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 227 00000100:00100000:0.0:1784584831.356315:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569020928:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1784584831.356421:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584831.356506:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569020928 00000100:00100000:3.0:1784584831.356516:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569020928 00000100:00100000:3.0:1784584831.356573:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784584831.356583:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3322:x1871272569020928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1784584831.356618:0:6608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1784584831.356663:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5e9a7d, atime: 0x6a5e9a7d, ctime: 0x6a5e9a7d, blocks: 0x1 00010000:00010000:3.0:1784584831.356672:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.356735:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1784584831.356740:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584831.356748:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.356768:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.356779:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.356787:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.356816:0:6608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:1.0:1784584831.357991:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c7c41dd480 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1784584831.358001:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7c651bc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c7e02fc6c0 00000020:00080000:1.0:1784584831.358004:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7c651b300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c7ff7af800 00000004:00080000:1.0:1784584831.358044:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:1.0:1784584831.358070:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c7c41dd3c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1784584831.358073:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7c651bd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c7c41ddb40 00000020:00080000:1.0:1784584831.358076:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7c651b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c7f4282800 00000004:00080000:1.0:1784584831.358148:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:1.0:1784584831.358173:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1784584831.358190:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1784584831.358396:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1784584831.358554:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7eff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569021056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1784584831.358628:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584831.358721:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569021056 00000100:00100000:2.0:1784584831.358731:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569021056 00000100:00100000:2.0:1784584831.358785:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784584831.358804:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3323:x1871272569021056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1784584831.358834:0:8782:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1784584831.358865:0:8782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.358891:0:8782:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb310a expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.358901:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1784584831.358905:0:8782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584831.358910:0:8782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.358964:0:8782:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb310a expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.358985:0:8782:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb310a expref: 12 pid: 6608 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.358998:0:8782:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8782:1871272569021184:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584831.359072:0:8782:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584831.359862:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784584831.359875:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7eff7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569021312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1784584831.359922:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584831.360058:0:6607:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1784584831.360067:0:6607:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1784584831.360356:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3322:x1871272569020928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3771us (3932us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1784584831.360368:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784584831.360395:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569021312 00000100:00100000:3.0:1784584831.360403:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569021312 00000100:00100000:3.0:1784584831.360434:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1784584831.360441:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1871272569021312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784584831.360647:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1784584831.360651:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784584830 00002000:00010000:3.0:1784584831.360653:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784584831.360655:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784584830 -> 1784584830 00002000:00010000:3.0:1784584831.360672:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784584831.361079:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3321:x1871272569021312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 637us (1155us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1784584831.361087:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1784584831.361115:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584831.361125:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.361139:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed600 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584831.361144:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.361156:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.361183:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.361191:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9e27737/0x787d778cc3ff1ed5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.361213:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584831.361215:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584831.361217:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784584831.361435:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7eff7c000/2, rc 0, transno 4294967321 00000100:00100000:1.0:1784584831.361444:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7eff7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569021312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1784584831.361534:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7ffd95880/2, rc 0, transno 4294967310 00000100:00100000:0.0:1784584831.361541:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569020928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1784584831.363275:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.363365:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549118464 00000100:00100000:2.0:1784584831.363376:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549118464 00000100:00100000:2.0:1784584831.363443:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1784584831.363453:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2354:x1871272549118464:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784584831.366015:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.366806:0:8782:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8782:1871272569021184:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584831.366847:0:8782:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584831.366916:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549118592 00000100:00100000:1.0:1784584831.366924:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549118592 00010000:00010000:1.0:1784584831.366970:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb310a expref: 14 pid: 6608 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584831.367011:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:1.0:1784584831.367021:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+14:2355:x1871272549118592:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584831.367041:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584831.367047:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb310a expref: 14 pid: 6608 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.367062:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb310a expref: 14 pid: 6608 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.367092:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff1c97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb310a expref: 14 pid: 6608 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.367110:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584831.367115:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584831.367122:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.367133:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.367173:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584831.367239:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+13:2355:x1871272549118592:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 219us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.367247:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00010000:00010000:1.0:1784584831.367320:0:8782:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.367329:0:8782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.367340:0:8782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.367348:0:8782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.367367:0:8782:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784584831.368169:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3323:x1871272569021056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9362us (9537us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1784584831.368180:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1784584831.368208:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584831.368215:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.368228:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584831.368241:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.368253:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.368279:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.368288:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff1edc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.368308:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584831.368310:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584831.368312:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784584831.368577:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7eff7df80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1784584831.368584:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7eff7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569021056:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1784584831.406183:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:3.0:1784584831.406213:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:3.0:1784584831.406228:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1784584831.406441:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549118464:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 42980us (43179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.406454:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:3.0:1784584831.408438:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.408561:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549118848 00000100:00100000:2.0:1784584831.408572:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549118848 00000100:00100000:2.0:1784584831.408682:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:2.0:1784584831.408732:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:11584:x1871272549118848:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784584831.408816:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584831.408850:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1ec0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb319d expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.408897:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:2.0:1784584831.408903:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584831.408941:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.408958:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.408970:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584831.409281:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000062a210a7 reply state 000000007d2abbee transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.409291:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784584831.409417:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:11584:x1871272549118848:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 724us (991us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1784584831.409424:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 228 00000100:00100000:1.0:1784584831.413654:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.413845:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549118976 00000100:00100000:2.0:1784584831.413866:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549118976 00000100:00100000:2.0:1784584831.413941:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:2.0:1784584831.413954:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2355:x1871272549118976:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784584831.414239:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784584831.414243:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1784584830 -> 1784584830 00002000:00010000:2.0:1784584831.414246:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1784584829 00002000:00010000:2.0:1784584831.414248:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1784584830 -> 1784584830 00002000:00010000:2.0:1784584831.414251:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784584831.414371:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2355:x1871272549118976:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 419us (730us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1784584831.414380:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00010000:00010000:3.0:1784584831.419084:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.419109:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.419118:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.419126:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3c00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584831.419133:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.419141:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.419166:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:3.0:1784584831.419170:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584831.419176:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.419182:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1ee3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.419546:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584831.419625:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549119232 00000100:00100000:3.0:1784584831.419638:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549119232 00000100:00100000:3.0:1784584831.419961:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:3.0:1784584831.419973:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:11584:x1871272549119232:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1784584831.420079:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.420093:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb318f expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.420102:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.420142:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb318f expref: 20 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.420158:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb318f expref: 20 pid: 5807 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584831.420175:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569021440:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584831.420299:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e423c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584831.423478:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584831.423670:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549119360 00000100:00100000:0.0:1784584831.423681:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549119360 00010000:00010000:0.0:1784584831.423762:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb318f expref: 21 pid: 5807 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584831.423913:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1784584831.423926:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:2354:x1871272549119360:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584831.423946:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584831.423953:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb318f expref: 21 pid: 5807 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.423968:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb318f expref: 21 pid: 5807 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.423996:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:0.0:1784584831.424002:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.424013:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.424041:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.424067:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584831.424143:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:2354:x1871272549119360:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 218us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584831.424151:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00010000:00010000:3.0:1784584831.425225:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2c00/0x787d778cc3ff1ea4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb318f expref: 20 pid: 5807 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584831.425248:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41d3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5808:1871272569021440:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584831.425284:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.425295:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.425302:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.425359:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.425367:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.425374:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.425381:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584831.425386:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.425395:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.425411:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:3.0:1784584831.425414:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1784584831.425419:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.425426:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed600/0x787d778cc3ff1eea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584831.425494:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:11584:x1871272549119232:12345-192.168.203.52@tcp:55:lhsmtool_posix.0 Request processed in 5523us (5954us total) trans 0 rc -22/-22 00000100:00100000:3.0:1784584831.425504:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 229 00000100:00100000:1.0:1784584831.430156:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.430303:0:12440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549119488 00000100:00100000:2.0:1784584831.430316:0:12440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549119488 00000100:00100000:2.0:1784584831.430427:0:12440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:2.0:1784584831.430439:0:12440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2356:x1871272549119488:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784584831.430504:0:12440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.430531:0:12440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 8 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.430541:0:12440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584831.430547:0:12440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784584831.430552:0:12440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.430599:0:12440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 8 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.430617:0:12440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 8 pid: 6607 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.430637:0:12440:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7ffd97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12440:1871272569021568:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584831.430811:0:12440:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584831.438226:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.438414:0:12440:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7ffd97100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12440:1871272569021568:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584831.438452:0:12440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584831.438645:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549119616 00000100:00100000:1.0:1784584831.438654:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549119616 00010000:00010000:1.0:1784584831.438746:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 9 pid: 6607 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584831.438792:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:1.0:1784584831.438803:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+9:2355:x1871272549119616:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584831.438822:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584831.439346:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 9 pid: 6607 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.439386:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 9 pid: 6607 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.439417:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000508c205f/0x787d778cc3ff1ece lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ab expref: 9 pid: 6607 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.439438:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584831.439443:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784584831.439449:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.439461:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.440535:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584831.440593:0:12440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.440607:0:12440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584831.440633:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2355:x1871272549119616:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 1826us (2415us total) trans 0 rc 0/0 00010000:00010000:1.0:1784584831.440643:0:12440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.440652:0:12440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.440678:0:12440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.440686:0:12440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584831.440720:0:12440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.440731:0:12440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.440746:0:12440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.440755:0:12440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff1ef1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584831.440811:0:12440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2356:x1871272549119488:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 10375us (10669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.440821:0:12440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 70 00000100:00100000:0.0:1784584831.441360:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:2.0:1784584831.446045:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.449990:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549119872 00000100:00100000:1.0:1784584831.450011:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549119872 00000100:00100000:0.0:1784584831.450934:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 230 00000100:00100000:0.0:1784584831.450953:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ffd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:11584:x1871272549119872:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784584831.451063:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.451087:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.451102:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.451420:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.451433:0:6997:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3196 expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.451589:0:6997:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.451635:0:6997:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3196 expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.451653:0:6997:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3196 expref: 20 pid: 5808 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584831.451671:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569021696:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584831.451819:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c41dd600 going to sleep for 11 seconds 00000100:00100000:3.0:1784584831.457447:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584831.457666:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569021696:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584831.457844:0:6997:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584831.458772:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549120000 00000100:00100000:1.0:1784584831.458787:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549120000 00010000:00010000:1.0:1784584831.458859:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3196 expref: 21 pid: 5808 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584831.458937:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:1.0:1784584831.458948:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:2355:x1871272549120000:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584831.458968:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584831.458976:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3196 expref: 21 pid: 5808 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.458991:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3196 expref: 21 pid: 5808 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.459018:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2a00/0x787d778cc3ff1eb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3196 expref: 21 pid: 5808 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.459038:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:1.0:1784584831.459043:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.459054:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.459062:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.459100:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584831.459184:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:2355:x1871272549120000:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 236us (1744us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.459192:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00010000:00010000:0.0:1784584831.459364:0:6997:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.459373:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584831.459607:0:6997:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1784584831.459821:0:6997:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1784584831.459868:0:6997:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1784584831.459967:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6997:1871272569021824:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1784584831.460039:0:6997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584831.460079:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ff7ba6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584831.460464:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569021824 00000100:00100000:1.0:1784584831.460476:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569021824 00000100:00100000:1.0:1784584831.460527:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1784584831.460538:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6997:x1871272569021824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784584831.460634:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6997:x1871272569021824:12345-0@lo:1000:mdt00_003.0 Request processed in 100us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.460642:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584831.460851:0:6997:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1784584831.460862:0:6997:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1784584831.460901:0:6997:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7eff7c000, transno 4294967321 00000100:00100000:3.0:1784584831.460927:0:6997:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff97c7eff7df80 x1871272569021056/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1784584847 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584831.460942:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6997:1871272569021824:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1784584831.461564:0:6997:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1784584831.462444:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6997:1871272569021952:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1784584831.462530:0:6997:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584831.462566:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5e42b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784584831.462597:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569021952 00000100:00100000:1.0:1784584831.462610:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569021952 00000100:00100000:1.0:1784584831.462739:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1784584831.462751:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6997:x1871272569021952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1784584831.463054:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6997:x1871272569021952:12345-0@lo:1000:mdt00_003.0 Request processed in 304us (522us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1784584831.463063:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584831.463122:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6997:1871272569021952:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1784584831.463165:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463176:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463185:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463191:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584831.463196:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463209:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463225:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:3.0:1784584831.463228:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584831.463232:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463254:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf200/0x787d778cc3ff1eff lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463299:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463307:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463313:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463318:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584831.463321:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463327:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463336:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584831.463338:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784584831.463346:0:6997:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1e49 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb317a expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463357:0:6997:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1e49 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb317a expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463367:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb317a expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.463410:0:6997:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1e49 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb317a expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584831.463423:0:6997:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569022080:192.168.203.52@tcp:105: 00000100:00100000:3.0:1784584831.463500:0:6997:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ff7ba6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584831.468101:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.469448:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549120128 00000100:00100000:2.0:1784584831.469467:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549120128 00000100:00100000:2.0:1784584831.469565:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:2.0:1784584831.469577:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:11583:x1871272549120128:12345-192.168.203.52@tcp:49:lfs.0 00000100:00100000:2.0:1784584831.469800:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+24:11583:x1871272549120128:12345-192.168.203.52@tcp:49:lfs.0 Request processed in 224us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.469808:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 61 00000100:00100000:0.0:1784584831.470009:0:6997:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41d0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6997:1871272569022080:192.168.203.52@tcp:105: 00010000:00010000:0.0:1784584831.470042:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470054:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff1e42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470095:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470111:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470127:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470138:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470145:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470151:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470158:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584831.470162:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470171:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470184:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584831.470205:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584831.470209:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470216:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be000/0x787d778cc3ff1f06 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470229:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470236:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470241:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470247:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584831.470249:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470255:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470272:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584831.470274:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784584831.470278:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584831.470284:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be200/0x787d778cc3ff1ef8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584831.470539:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ffd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:11584:x1871272549119872:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 19594us (24506us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1784584831.470558:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 230 00000020:00080000:0.0:1784584831.470563:0:6997:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784584831.476766:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784584831.476782:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584831.477306:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1784584831.477318:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784584831.477946:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584831.478217:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.478389:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549120640 00000100:00100000:1.0:1784584831.478405:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549120640 00000100:00100000:1.0:1784584831.478480:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 62 00000100:00100000:1.0:1784584831.478490:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6425c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+23:11584:x1871272549120640:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1784584831.480237:0:5810:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784584831.480425:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1784584831.480475:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.480492:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.480504:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.480513:0:5810:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.480527:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.480652:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584831.480758:0:5810:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784584831.480872:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549120384 00000100:00100000:1.0:1784584831.480883:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6425c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+25:11584:x1871272549120640:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 2387us (2658us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1784584831.480889:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549120384 00000100:00100000:1.0:1784584831.480897:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 62 00000020:00080000:1.0:1784584831.480904:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1784584831.480975:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 231 00000100:00100000:2.0:1784584831.480989:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+25:11583:x1871272549120384:12345-192.168.203.52@tcp:58:lfs.0 00000040:00080000:2.0:1784584831.481285:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1784584831.481378:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+25:11583:x1871272549120384:12345-192.168.203.52@tcp:58:lfs.0 Request processed in 391us (3439us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.481387:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 231 00010000:00010000:3.0:1784584831.481993:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584831.482003:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.482013:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584831.482018:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.482027:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.482045:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff97c7d6b88f00) 00010000:00010000:3.0:1784584831.482049:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784584831.482054:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.482061:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.482118:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584831.482137:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584831.482238:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584831.523065:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.523280:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549120768 00000100:00100000:2.0:1784584831.523293:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549120768 00000100:00100000:2.0:1784584831.523418:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:2.0:1784584831.523430:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+25:11586:x1871272549120768:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584831.523463:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584831.523492:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1f14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb31b2 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.523574:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.523591:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.523604:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.523622:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.523630:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.523637:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.524051:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.524065:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3173 expref: 26 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.524082:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.524125:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3173 expref: 26 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.524141:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3173 expref: 26 pid: 6997 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584831.524156:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569022208:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584831.524289:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b180 going to sleep for 11 seconds 00000100:00100000:2.0:1784584831.528086:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5806:1871272569022208:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584831.528128:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584831.528664:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584831.528960:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549121024 00000100:00100000:2.0:1784584831.528970:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549121024 00000100:00100000:2.0:1784584831.529043:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:2.0:1784584831.529055:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:5567:x1871272549121024:12345-192.168.203.52@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784584831.529385:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:5567:x1871272549121024:12345-192.168.203.52@tcp:35:ldlm_bl.0 Request processed in 330us (722us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1784584831.529394:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 63 00000100:00100000:1.0:1784584831.542145:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584831.542455:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549121152 00000100:00100000:3.0:1784584831.542468:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549121152 00010000:00010000:3.0:1784584831.542518:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3173 expref: 28 pid: 6997 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584831.542621:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:3.0:1784584831.542633:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:2355:x1871272549121152:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584831.542651:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584831.542658:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3173 expref: 28 pid: 6997 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.542673:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3173 expref: 28 pid: 6997 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.542759:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3400/0x787d778cc3ff1e34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3173 expref: 28 pid: 6997 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.542779:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584831.542793:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.542805:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.542814:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584831.542854:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584831.542914:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:2355:x1871272549121152:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 283us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584831.542939:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00010000:00010000:2.0:1784584831.543020:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.543030:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584831.543089:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784584831.543094:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784584831.543120:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.543134:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.543145:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.543152:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.543159:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.543166:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2800 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584831.543170:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.543178:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.543188:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584831.543191:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584831.543195:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.543201:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2800/0x787d778cc3ff1f1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544039:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544045:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544051:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544056:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584831.544059:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544065:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544076:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff97c7c58a0b00) 00010000:00010000:2.0:1784584831.544078:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584831.544082:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544088:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2400/0x787d778cc3ff1f22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544135:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff1f14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31b2 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544150:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31b2 expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584831.544171:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:2.0:1784584831.544174:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584831.544176:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2200, rc 0) 00000100:00100000:2.0:1784584831.544243:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:11586:x1871272549120768:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 20814us (21193us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584831.544251:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 232 00000100:00100000:1.0:1784584831.940200:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.940253:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.940293:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.940314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.940339:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584831.940372:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549121664 00000100:00100000:1.0:1784584831.940382:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549121664 00000100:00100000:1.0:1784584831.940425:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549121536 00000100:00100000:1.0:1784584831.940429:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549121536 00000100:00100000:1.0:1784584831.940449:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1784584831.940458:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2356:x1871272549121664:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584831.940527:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2356:x1871272549121664:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 69us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.940535:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 74 00000100:00100000:1.0:1784584831.940563:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1784584831.940569:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2357:x1871272549121536:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584831.940597:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2357:x1871272549121536:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.940602:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:1.0:1784584831.940629:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549121408 00000100:00100000:1.0:1784584831.940633:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549121408 00000100:00100000:1.0:1784584831.940655:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549121792 00000100:00100000:1.0:1784584831.940658:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549121792 00000100:00100000:1.0:1784584831.940687:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:1.0:1784584831.940722:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7eff7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:2356:x1871272549121408:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584831.940755:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7eff7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:2356:x1871272549121408:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584831.940763:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 144 00000100:00100000:0.0:1784584831.941086:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:0.0:1784584831.941096:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549121792:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584831.941127:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff7a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549121792:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 33us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584831.941145:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 145 00000100:00100000:3.0:1784584831.941330:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549121280 00000100:00100000:3.0:1784584831.941335:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549121280 00000100:00100000:3.0:1784584831.941365:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 290 00000100:00100000:3.0:1784584831.941371:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549121280:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584831.941399:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7e03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549121280:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584831.941406:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 290 00000100:00080000:0.0:1784584831.941810:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784584832.286503:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584832.305932:0:12478:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784584832.305941:0:12478:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584832.305986:0:12478:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784584832.305992:0:12478:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1784584832.540158:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784584832.540166:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584832.540207:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784584832.540214:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784584832.540355:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c89500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569022336:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784584832.540458:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784584832.544438:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584832.544921:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549121920 00000100:00100000:0.0:1784584832.544931:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549121920 00000100:00100000:0.0:1784584832.545007:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00100000:0.0:1784584832.545017:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:11598:x1871272549121920:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784584832.545048:0:5807:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784584832.545276:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:11598:x1871272549121920:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 260us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584832.545285:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 233 00000100:00080000:3.0:1784584832.545987:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584832.546410:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c89500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11550:1871272569022336:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784584832.549493:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584832.549566:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549122176 00000100:00100000:1.0:1784584832.549574:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549122176 00000100:00100000:1.0:1784584832.549629:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:1.0:1784584832.549641:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+26:11598:x1871272549122176:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584832.549663:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584832.549682:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb31b9 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584832.550343:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1f37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584832.550358:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584832.550384:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584832.550394:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784584832.551599:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818200/0x787d778cc3ff1f30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31b9 expref: 29 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584832.551626:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31b9 expref: 28 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584832.551635:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:1.0:1784584832.551638:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784584832.551641:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818c00, rc 0) 00000100:00100000:1.0:1784584832.552125:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:11598:x1871272549122176:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2486us (2638us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1784584832.552135:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 234 00000100:00100000:0.0:1784584832.562162:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584832.563737:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549122304 00000100:00100000:3.0:1784584832.563750:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549122304 00000100:00100000:2.0:1784584832.563965:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1784584832.563976:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:2356:x1871272549122304:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584832.563993:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584832.564019:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1f37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31b9 expref: 28 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564036:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:2.0:1784584832.564053:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584832.564118:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:2356:x1871272549122304:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 144us (1965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584832.564127:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:0.0:1784584832.564267:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584832.564407:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549122560 00000100:00100000:2.0:1784584832.564412:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549122560 00000100:00100000:2.0:1784584832.564443:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 235 00000100:00100000:2.0:1784584832.564462:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+27:11598:x1871272549122560:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784584832.564525:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564540:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564549:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564769:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564785:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564792:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564798:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584832.564803:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564812:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564838:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:2.0:1784584832.564842:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784584832.564845:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584832.564851:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff1f45 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584832.564977:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:11598:x1871272549122560:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 525us (719us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1784584832.564984:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 235 00000040:00080000:1.0:1784584832.565275:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784584832.565280:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784584832.565802:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784584832.565818:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784584832.568531:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584832.568730:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549122816 00000100:00100000:2.0:1784584832.568740:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549122816 00000100:00100000:2.0:1784584832.568892:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1784584832.568903:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+28:11598:x1871272549122816:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784584832.569133:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:11598:x1871272549122816:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 230us (609us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1784584832.569142:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 64 00000100:00100000:2.0:1784584833.052199:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c41d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569022464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584833.052321:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584833.052475:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569022464 00000100:00100000:3.0:1784584833.052487:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569022464 00000100:00100000:3.0:1784584833.052567:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784584833.052581:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1871272569022464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584833.052628:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584833.052682:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1871272569022464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584833.052720:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1784584833.053341:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584833.053398:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c41d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569022464:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1784584833.126111:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1784584833.126140:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1784584833.126150:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1784584833.308368:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584834.038178:0:12532:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784584834.038188:0:12532:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584834.038237:0:12532:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784584834.038259:0:12532:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784584834.202150:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584834.204449:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549123072 00000100:00100000:1.0:1784584834.204463:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549123072 00000100:00100000:1.0:1784584834.204574:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00100000:1.0:1784584834.204585:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+29:11618:x1871272549123072:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584834.204610:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584834.204631:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1f4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb31c0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584834.204791:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1f53 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584834.204806:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584834.204824:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1f53 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584834.204835:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1784584834.204957:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801818c00/0x787d778cc3ff1f4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31c0 expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584834.204976:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1f53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31c0 expref: 31 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584834.204985:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:1.0:1784584834.204988:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784584834.204992:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819c00, rc 0) 00000100:00100000:1.0:1784584834.205060:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+31:11618:x1871272549123072:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 477us (2986us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1784584834.205067:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 236 00000100:00080000:2.0:1784584834.205450:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584834.208486:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584834.209475:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549123200 00000100:00100000:0.0:1784584834.209490:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549123200 00000100:00100000:0.0:1784584834.210017:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:0.0:1784584834.210031:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+31:11618:x1871272549123200:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:0.0:1784584834.210143:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584834.210165:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584834.210179:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584834.210214:0:6997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584834.210221:0:6997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584834.210228:0:6997:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584834.210233:0:6997:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bee00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584834.210238:0:6997:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584834.210256:0:6997:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584834.210270:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584834.210273:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584834.210279:0:6997:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584834.210286:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f61 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584834.210732:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+31:11618:x1871272549123200:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 701us (2257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584834.210742:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 237 00000100:00100000:3.0:1784584834.301097:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584834.301213:0:12440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549123328 00000100:00100000:1.0:1784584834.301230:0:12440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549123328 00000100:00100000:1.0:1784584834.301350:0:12440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00080000:2.0:1784584834.301352:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584834.301367:0:12440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2357:x1871272549123328:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:1.0:1784584834.301399:0:12440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584834.301432:0:12440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1f68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb31c7 expref: -99 pid: 12440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784584834.301460:0:12440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a5e9a7e, atime: 0x6a5e9a7d, ctime: 0x6a5e9a7e, blocks: 0xb 00010000:00010000:1.0:1784584834.301479:0:12440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1784584834.301484:0:12440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584834.301494:0:12440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1f68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31c7 expref: 8 pid: 12440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584834.301511:0:12440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1f68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31c7 expref: 8 pid: 12440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584834.301524:0:12440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818c00, rc 0) 00000100:00100000:1.0:1784584834.301593:0:12440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3e56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2357:x1871272549123328:12345-192.168.203.52@tcp:101:cat.0 Request processed in 233us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584834.301601:0:12440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 71 00000100:00100000:2.0:1784584834.322405:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584834.327430:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549123456 00000100:00100000:3.0:1784584834.327454:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549123456 00002000:00100000:3.0:1784584834.327538:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff97c7faa79180 x1871272549123456/t0(0) o3->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:405/0 lens 488/0 e 0 to 0 dl 1784584845 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784584834.327568:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7faa79180 with x1871272549123456 ext(0->4095) 00002000:00010000:3.0:1784584834.327577:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7faa79180 00000100:00100000:3.0:1784584834.327612:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:3.0:1784584834.327624:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2356:x1871272549123456:12345-192.168.203.52@tcp:3:cat.0 00000100:00100000:3.0:1784584834.328281:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+8:2356:x1871272549123456:12345-192.168.203.52@tcp:3:cat.0 Request processed in 657us (5887us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784584834.328292:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00002000:00100000:3.0:1784584834.328301:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff97c7faa79180 x1871272549123456/t0(0) o3->4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2@192.168.203.52@tcp:405/0 lens 488/4536 e 0 to 0 dl 1784584845 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784584834.328310:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff97c7faa79180 with x1871272549123456 ext(0->4095) 00002000:00010000:3.0:1784584834.328313:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff97c7faa79180 00010000:00010000:3.0:1784584834.334668:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584835.356172:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584836.124110:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f400aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569022592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584836.124241:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584836.124279:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569022720:0@lo:400:kworker.0 00000100:00100000:3.0:1784584836.124593:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584836.125275:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569022592 00000100:00100000:2.0:1784584836.125287:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569022592 00000100:00100000:2.0:1784584836.125363:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784584836.125374:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569022592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584836.125425:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584836.126031:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569022592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 658us (1800us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584836.126040:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1784584836.126190:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584836.126241:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569022848:0@lo:400:kworker.0 00000100:00100000:2.0:1784584836.126288:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584836.126322:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584836.126329:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569022976:0@lo:400:kworker.0 00000100:00100000:2.0:1784584836.126354:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584836.126387:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569023104:0@lo:400:kworker.0 00000100:00100000:2.0:1784584836.126413:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584836.126449:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1784584836.126524:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7ffd95f80, transno 4294967307 00000004:00080000:2.0:1784584836.126624:0:3322:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1784584836.126668:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7ffd95880, transno 4294967310 00000100:00100000:2.0:1784584836.126685:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f400aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569022592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584836.127137:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569022720 00000100:00100000:1.0:1784584836.127148:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569022720 00000100:00100000:1.0:1784584836.127202:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1784584836.127212:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272569022720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584836.127279:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569022848 00000100:00100000:2.0:1784584836.127283:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569022848 00000100:00100000:1.0:1784584836.127294:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272569022720:12345-0@lo:400:kworker.0 Request processed in 84us (2701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584836.127301:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1784584836.127314:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569022976 00000100:00100000:2.0:1784584836.127318:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569022976 00000100:00100000:2.0:1784584836.127356:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1784584836.127365:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569022848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584836.127402:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569022720:0@lo:400:kworker.0 00000100:00100000:0.0:1784584836.127418:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1784584836.127425:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569022848:12345-0@lo:400:kworker.0 Request processed in 59us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584836.127427:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569023232:0@lo:400:kworker.0 00000100:00100000:0.0:1784584836.127433:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569022976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584836.127441:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784584836.127466:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584836.127472:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569022976:12345-0@lo:400:kworker.0 Request processed in 47us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584836.127479:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1784584836.127656:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584836.127681:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4257480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569022976:0@lo:400:kworker.0 00000100:00100000:2.0:1784584836.127826:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569022848:0@lo:400:kworker.0 00000100:00100000:1.0:1784584836.127878:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569023104 00000100:00100000:1.0:1784584836.127884:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569023104 00000100:00100000:1.0:1784584836.127924:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784584836.127931:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3322:x1871272569023104:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784584836.127979:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584836.127982:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3322:x1871272569023104:12345-0@lo:400:kworker.0 Request processed in 52us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584836.127989:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784584836.128006:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569023104:0@lo:400:kworker.0 00000100:00100000:0.0:1784584836.128444:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569023232 00000100:00100000:0.0:1784584836.128449:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569023232 00000100:00100000:0.0:1784584836.128548:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784584836.128556:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569023232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584836.128904:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569023232:12345-0@lo:400:kworker.0 Request processed in 348us (1437us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584836.128912:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1784584836.129038:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584836.129313:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569023232:0@lo:400:kworker.0 00010000:00010000:3.0:1784584836.381604:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784584836.693225:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00000001:00080000:1.0:1784584836.693258:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1784584836.693275:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1784584836.693315:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97c7c5e42d80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1784584836.693321:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7ff965a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97c7c5e423c0 00000020:00080000:1.0:1784584836.693325:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff97c7ff965400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97c7f44ab400 00000020:00080000:0.0:1784584836.696024:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1784584836.696256:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1784584836.716822:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:3.0:1784584836.716849:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:1.0:1784584837.065218:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584837.065285:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584837.065316:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584837.065336:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584837.065374:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584837.065407:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549123840 00000100:00100000:1.0:1784584837.065421:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549123840 00000100:00100000:1.0:1784584837.065492:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549123968 00000100:00100000:1.0:1784584837.065496:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549123968 00000100:00100000:1.0:1784584837.065533:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:1.0:1784584837.065545:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2357:x1871272549123840:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584837.065931:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2357:x1871272549123840:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 113us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584837.065943:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:1.0:1784584837.065966:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:1.0:1784584837.065973:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549123968:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584837.066008:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2357:x1871272549123968:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 35us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584837.066033:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:1.0:1784584837.066059:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549124096 00000100:00100000:1.0:1784584837.066063:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549124096 00000100:00100000:1.0:1784584837.066097:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549123712 00000100:00100000:1.0:1784584837.066100:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549123712 00000100:00100000:1.0:1784584837.066122:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:1.0:1784584837.066129:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549124096:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584837.066160:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ec120a06-153f-439e-85c8-b41da9afb57f+5:2357:x1871272549124096:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 31us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584837.066168:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 149 00000100:00100000:1.0:1784584837.066180:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:1.0:1784584837.066186:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:2357:x1871272549123712:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584837.066218:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:2357:x1871272549123712:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584837.066235:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 150 00000100:00100000:3.0:1784584837.067475:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549123584 00000100:00100000:3.0:1784584837.067490:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549123584 00000100:00100000:3.0:1784584837.067571:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 292 00000100:00100000:3.0:1784584837.067597:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549123584:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584837.067672:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2357:x1871272549123584:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 65us (2458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584837.067680:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 292 00000100:00080000:3.0:1784584837.067747:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784584837.067754:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784584837.067757:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784584837.404037:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584837.724083:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784584837.724100:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584837.724304:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784584837.724313:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784584838.175322:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569023360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584838.175417:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584838.175479:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569023360 00000100:00100000:0.0:1784584838.175496:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569023360 00000100:00100000:0.0:1784584838.175647:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784584838.175660:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569023360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784584838.175730:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784584838.175811:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584838.176686:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569023360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1025us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584838.176721:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784584838.176804:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1784584838.176811:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7eff7df80, transno 4294967322 00000004:00080000:0.0:1784584838.176894:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1784584838.176924:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3cf2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569023360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1784584838.428125:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584838.831093:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584838.831353:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549124224 00000100:00100000:1.0:1784584838.831367:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549124224 00000100:00100000:1.0:1784584838.831448:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:1.0:1784584838.831458:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:11263:x1871272549124224:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1784584838.833290:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:11263:x1871272549124224:12345-192.168.203.52@tcp:60:lhsmtool_posix.0 Request processed in 1818us (2197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584838.833306:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 238 00000100:00100000:3.0:1784584838.839861:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584838.839995:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549124480 00000100:00100000:0.0:1784584838.840008:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549124480 00000100:00100000:0.0:1784584838.840087:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:0.0:1784584838.840099:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:11263:x1871272549124480:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784584838.840811:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:11263:x1871272549124480:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 710us (960us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1784584838.840822:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 65 00000100:00100000:1.0:1784584839.089485:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584839.089571:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549124608 00000100:00100000:0.0:1784584839.089585:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549124608 00000100:00100000:0.0:1784584839.089682:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00100000:0.0:1784584839.089729:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+5:12069:x1871272549124608:12345-192.168.203.52@tcp:101:lsof.0 00010000:00010000:0.0:1784584839.089766:0:6997:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584839.089794:0:6997:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb31ce expref: -99 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584839.089879:0:6997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1f76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584839.089896:0:6997:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584839.089930:0:6997:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584839.090188:0:6997:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784584839.090192:0:6997:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584839.090296:0:6997:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1f76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6997 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584839.090329:0:6997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bee00/0x787d778cc3ff1f6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ce expref: 7 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584839.090349:0:6997:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1f76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ce expref: 6 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584839.090358:0:6997:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189cc00) 00010000:00010000:0.0:1784584839.090361:0:6997:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584839.090365:0:6997:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfe00, rc 0) 00000100:00100000:0.0:1784584839.090456:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+6:12069:x1871272549124608:12345-192.168.203.52@tcp:101:lsof.0 Request processed in 763us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584839.090464:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 239 00000100:00080000:2.0:1784584839.090642:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784584839.454916:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584840.477339:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584841.244148:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584841.244181:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569023488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584841.244287:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584841.244868:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569023488 00000100:00100000:3.0:1784584841.244883:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569023488 00000100:00100000:3.0:1784584841.244996:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1784584841.245010:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569023488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784584841.245082:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584841.245176:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569023488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584841.245186:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1784584841.245536:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584841.245557:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569023872:0@lo:400:kworker.0 00000100:00100000:2.0:1784584841.245599:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584841.245669:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569023488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584841.245715:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584841.245721:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569024000:0@lo:400:kworker.0 00000100:00100000:1.0:1784584841.245825:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569023872 00000100:00100000:1.0:1784584841.245830:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569023872 00000100:00100000:1.0:1784584841.245873:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1784584841.245881:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569023872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584841.245925:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569023872:12345-0@lo:400:kworker.0 Request processed in 46us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584841.245951:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1784584841.246033:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584841.246113:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569023872:0@lo:400:kworker.0 00000100:00080000:2.0:1784584841.246133:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584841.246741:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569023744:0@lo:400:kworker.0 00000100:00100000:0.0:1784584841.246787:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584841.246828:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784584841.246835:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f3f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569023616:0@lo:400:kworker.0 00000100:00100000:0.0:1784584841.246866:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584841.246890:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569024128:0@lo:400:kworker.0 00000100:00100000:0.0:1784584841.246912:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584841.246959:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569023744 00000100:00100000:0.0:1784584841.246965:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569023744 00000100:00100000:0.0:1784584841.246999:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569024128 00000100:00100000:0.0:1784584841.247003:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569024128 00000100:00100000:0.0:1784584841.247027:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784584841.247033:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569023744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584841.247079:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569023744:12345-0@lo:400:kworker.0 Request processed in 46us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584841.247086:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1784584841.247101:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784584841.247107:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569024128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584841.247132:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4256a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569024128:12345-0@lo:400:kworker.0 Request processed in 26us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584841.247138:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1784584841.247173:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569024128:0@lo:400:kworker.0 00000100:00100000:0.0:1784584841.247182:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569023744:0@lo:400:kworker.0 00000100:00100000:2.0:1784584841.247755:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569023616 00000100:00100000:2.0:1784584841.247762:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569023616 00000100:00100000:2.0:1784584841.247803:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1784584841.247810:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272569023616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584841.247865:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272569023616:12345-0@lo:400:kworker.0 Request processed in 55us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584841.247872:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:2.0:1784584841.247903:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584841.250059:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569024000 00000100:00100000:1.0:1784584841.250078:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569024000 00000100:00100000:1.0:1784584841.250280:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784584841.250292:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569024000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584841.250409:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569024000:12345-0@lo:400:kworker.0 Request processed in 120us (4375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584841.250417:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784584841.250477:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f3f01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569023616:0@lo:400:kworker.0 00000100:00100000:0.0:1784584841.250549:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569024000:0@lo:400:kworker.0 00000100:00080000:2.0:1784584841.250773:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784584841.500023:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784584841.813281:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1784584841.813306:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1784584841.813350:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1784584841.813365:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1784584842.208113:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584842.208160:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584842.208287:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549124992 00000100:00100000:3.0:1784584842.208302:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584842.208313:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549124992 00000100:00100000:3.0:1784584842.208337:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584842.208392:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584842.208449:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549124736 00000100:00100000:1.0:1784584842.208454:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549124736 00000100:00100000:1.0:1784584842.208497:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:1.0:1784584842.208509:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549124736:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584842.208623:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2354:x1871272549124736:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 115us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584842.208633:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 294 00000100:00100000:1.0:1784584842.208833:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549125248 00000100:00100000:1.0:1784584842.208838:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549125248 00000100:00100000:1.0:1784584842.208876:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549124864 00000100:00100000:1.0:1784584842.208879:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549124864 00000100:00100000:1.0:1784584842.208904:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:1.0:1784584842.208912:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+6:2354:x1871272549125248:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584842.208954:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ec120a06-153f-439e-85c8-b41da9afb57f+6:2354:x1871272549125248:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584842.208960:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 154 00000100:00100000:1.0:1784584842.208984:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00100000:1.0:1784584842.208991:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:2354:x1871272549124864:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584842.209032:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:2354:x1871272549124864:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 42us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584842.209040:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 155 00000100:00080000:1.0:1784584842.209181:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784584842.209187:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584842.212366:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549125120 00000100:00100000:0.0:1784584842.213215:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549125120 00000100:00100000:0.0:1784584842.213526:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:0.0:1784584842.213542:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c41d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549124992:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584842.214020:0:12440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:1.0:1784584842.214033:0:12440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2354:x1871272549125120:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584842.214125:0:12440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2354:x1871272549125120:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 95us (5733us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584842.214134:0:12440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1784584842.215479:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c41d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2354:x1871272549124992:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 1927us (7302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584842.215501:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00080000:0.0:1784584842.215549:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1784584842.528219:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784584842.563391:0:12735:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:00:40 (1784584840) 00000100:00100000:3.0:1784584843.292383:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584843.292407:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569024256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584843.292482:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584843.292587:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569024256 00000100:00100000:2.0:1784584843.292595:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569024256 00000100:00100000:2.0:1784584843.292673:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784584843.292682:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569024256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584843.292742:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584843.292783:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569024256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584843.292790:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1784584843.293071:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784584843.293106:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569024256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1784584843.571131:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584844.572210:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584845.598517:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584846.366010:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569024384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584846.366098:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584846.366253:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569024384 00000100:00100000:1.0:1784584846.366262:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569024384 00000100:00100000:1.0:1784584846.366328:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784584846.366337:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569024384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584846.366375:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584846.366421:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569024384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584846.366429:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1784584846.367614:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584846.367664:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801ab3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569024384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584846.369747:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569024512:0@lo:400:kworker.0 00000100:00100000:2.0:1784584846.369818:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584846.370003:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569024512 00000100:00100000:0.0:1784584846.370010:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569024512 00000100:00100000:0.0:1784584846.370063:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1784584846.370071:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569024512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584846.370203:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c247b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569024896:0@lo:400:kworker.0 00000100:00100000:1.0:1784584846.370235:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584846.370280:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272569024768:0@lo:400:kworker.0 00000100:00100000:1.0:1784584846.370305:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584846.370323:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784584846.370342:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569024640:0@lo:400:kworker.0 00000100:00100000:1.0:1784584846.370365:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584846.370389:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569024768 00000100:00100000:1.0:1784584846.370393:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569024768 00000100:00100000:1.0:1784584846.370426:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569024640 00000100:00100000:1.0:1784584846.370430:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569024640 00000100:00100000:1.0:1784584846.370449:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784584846.370502:0:8782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569024896 00000100:00100000:3.0:1784584846.370506:0:8782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569024896 00000100:00100000:3.0:1784584846.370534:0:8782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784584846.370541:0:8782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569024896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584846.370576:0:8782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569024896:12345-0@lo:400:kworker.0 Request processed in 36us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584846.370582:0:8782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1784584846.370631:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c247b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569024896:0@lo:400:kworker.0 00000100:00100000:0.0:1784584846.370642:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c4006421-7015-489e-aaaa-81e9219afdea+19:3321:x1871272569024512:12345-0@lo:400:kworker.0 Request processed in 569us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584846.370647:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784584846.370651:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1784584846.370656:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569025024:0@lo:400:kworker.0 00000100:00100000:3.0:1784584846.370684:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584846.370732:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569025024 00000100:00100000:3.0:1784584846.370744:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569025024 00000100:00100000:3.0:1784584846.370762:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784584846.370768:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569024640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584846.370799:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569024640:12345-0@lo:400:kworker.0 Request processed in 31us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584846.370805:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784584846.370815:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784584846.370820:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569025024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584846.371064:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569025024:12345-0@lo:400:kworker.0 Request processed in 243us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584846.371070:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784584846.371109:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2479f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569024640:0@lo:400:kworker.0 00000100:00100000:3.0:1784584846.371135:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569025024:0@lo:400:kworker.0 00000100:00080000:3.0:1784584846.371158:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584846.371163:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584846.371962:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569024512:0@lo:400:kworker.0 00000100:00100000:1.0:1784584846.371999:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272569024768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584846.372062:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272569024768:12345-0@lo:400:kworker.0 Request processed in 1606us (1755us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584846.372071:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784584846.376248:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272569024768:0@lo:400:kworker.0 00000100:00100000:1.0:1784584846.525054:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584846.525139:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549125504 00000100:00100000:0.0:1784584846.525150:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549125504 00000100:00100000:0.0:1784584846.525235:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:0.0:1784584846.525246:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+18:12290:x1871272549125504:12345-192.168.203.52@tcp:35:umount.0 00000100:00080000:3.0:1784584846.525797:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584846.525995:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:12290:x1871272549125504:12345-192.168.203.52@tcp:35:umount.0 Request processed in 749us (949us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1784584846.526005:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 66 00000100:00100000:1.0:1784584846.531650:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584846.532544:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549125760 00000100:00100000:0.0:1784584846.532571:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549125760 00000100:00100000:0.0:1784584846.532635:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:0.0:1784584846.532646:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+19:12290:x1871272549125760:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:0.0:1784584846.533197:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:12290:x1871272549125760:12345-192.168.203.52@tcp:35:umount.0 Request processed in 549us (1553us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1784584846.533206:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 67 00000100:00100000:0.0:1784584846.539485:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584846.541279:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549126016 00000100:00100000:2.0:1784584846.541293:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549126016 00000100:00100000:2.0:1784584846.541398:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:2.0:1784584846.541408:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c6425050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+20:12290:x1871272549126016:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:2.0:1784584846.542192:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c6425050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:12290:x1871272549126016:12345-192.168.203.52@tcp:35:umount.0 Request processed in 782us (2713us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1784584846.542201:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 68 00000100:00100000:1.0:1784584846.547377:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584846.547484:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549126272 00000100:00100000:0.0:1784584846.547494:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549126272 00000100:00100000:0.0:1784584846.547551:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:0.0:1784584846.547561:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:12290:x1871272549126272:12345-192.168.203.52@tcp:35:umount.0 00000100:00100000:0.0:1784584846.548117:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:12290:x1871272549126272:12345-192.168.203.52@tcp:35:umount.0 Request processed in 556us (748us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1784584846.548126:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 69 00000100:00100000:1.0:1784584846.555589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584846.555644:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584846.555679:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584846.555859:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549126400 00000100:00100000:2.0:1784584846.555868:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549126400 00000100:00100000:2.0:1784584846.555923:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549126656 00000100:00100000:2.0:1784584846.555927:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549126656 00000100:00100000:2.0:1784584846.555952:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549126528 00000100:00100000:2.0:1784584846.555955:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549126528 00000100:00100000:2.0:1784584846.555974:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1784584846.555983:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+15:2356:x1871272549126400:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584846.555998:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584846.556017:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fce00/0x787d778cc3ff0f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d59 expref: 15 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584846.556049:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584846.556097:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+14:2356:x1871272549126400:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 115us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584846.556104:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:2.0:1784584846.556122:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1784584846.556128:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+13:2356:x1871272549126656:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584846.556136:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584846.556146:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c801818e00/0x787d778cc3ff11d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e24 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584846.556155:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584846.556185:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a81c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:2356:x1871272549126656:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 57us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584846.556191:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:2.0:1784584846.556234:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:2.0:1784584846.556240:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+11:2356:x1871272549126528:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584846.556247:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584846.556255:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bfc00/0x787d778cc3ff0f54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d21 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584846.556264:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584846.556280:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549126528:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 40us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584846.556287:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:1.0:1784584846.558157:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584846.558732:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549126784 00000100:00100000:0.0:1784584846.558741:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549126784 00000100:00100000:0.0:1784584846.558808:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 72 00000100:00100000:0.0:1784584846.558817:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2353:x1871272549126784:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:0.0:1784584846.558847:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff12c6 00000100:00080000:0.0:1784584846.558855:0:6608:0:(import.c:65:import_set_state_nolock()) ffff97c7fbe49800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784584846.558891:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:2.0:1784584846.559039:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584846.559511:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+2:2353:x1871272549126784:12345-192.168.203.52@tcp:9:umount.0 Request processed in 692us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584846.559519:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 72 00010000:00010000:3.0:1784584846.559787:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584846.570787:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584846.570864:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549127168 00000100:00100000:3.0:1784584846.570874:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549127168 00000100:00100000:3.0:1784584846.570948:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 73 00000100:00100000:3.0:1784584846.570958:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+7:2353:x1871272549127168:12345-192.168.203.52@tcp:9:umount.0 00000020:00000080:3.0:1784584846.570986:0:6607:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff1527 00000020:00010000:3.0:1784584846.570992:0:6607:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97c7d8a4d800: total 0 00000100:00080000:3.0:1784584846.570996:0:6607:0:(import.c:65:import_set_state_nolock()) ffff97c7d8a4b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784584846.571034:0:6607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1784584846.571275:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+5:2353:x1871272549127168:12345-192.168.203.52@tcp:9:umount.0 Request processed in 313us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584846.571283:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 73 00000020:00010000:1.0:1784584846.571471:0:5794:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97c7d8a4d800: total 0 00010000:00010000:1.0:1784584846.571500:0:5794:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97c7d8a4d800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1784584846.571546:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff18ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ff9 expref: 4 pid: 8782 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584846.571574:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d5cd3be2/0x787d778cc3ff1f68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31c7 expref: 3 pid: 12440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584846.571587:0:5794:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97c7d8a4d800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1784584846.571607:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584846.571609:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584846.571611:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584846.572142:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584846.586479:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584846.586594:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549128192 00000100:00100000:3.0:1784584846.586605:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549128192 00000100:00100000:3.0:1784584846.586673:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 240 00000100:00100000:3.0:1784584846.586683:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7efeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+22:2353:x1871272549128192:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:3.0:1784584846.587076:0:5808:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0f62 00000020:00010000:3.0:1784584846.587092:0:5808:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97c7c5ee2000: total 0 00000100:00080000:3.0:1784584846.587097:0:5808:0:(import.c:65:import_set_state_nolock()) ffff97c7c5ee5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784584846.587122:0:5808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1784584846.587496:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7efeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2+21:2353:x1871272549128192:12345-192.168.203.52@tcp:39:umount.0 Request processed in 812us (1024us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1784584846.587516:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 240 00000020:00010000:0.0:1784584846.587735:0:5793:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97c7c5ee2000: total 0 00010000:00010000:0.0:1784584846.587739:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584846.587784:0:5793:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97c7c5ee2000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1784584846.587818:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584846.587822:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784584846.587829:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff1589 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2f20 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.587847:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c7c58a0c00) 00010000:00010000:0.0:1784584846.587850:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584846.587854:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff122c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e32 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.587888:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584846.587890:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784584846.587895:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff1c27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb30ee expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.587908:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff97c7d6b88c00) 00010000:00010000:0.0:1784584846.587910:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784584846.587914:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819e00/0x787d778cc3ff129c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e4e expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.587929:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584846.587931:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584846.587934:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec400/0x787d778cc3ff1e49 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb317a expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.588174:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584846.588177:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784584846.588189:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf800/0x787d778cc3ff1948 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb301c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.588209:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584846.588212:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584846.588216:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff17ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fac expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.588228:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189ce00) 00010000:00010000:0.0:1784584846.588230:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584846.588234:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff1248 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e39 expref: 13 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.588248:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189cc00) 00010000:00010000:0.0:1784584846.588251:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584846.588254:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaecc00/0x787d778cc3ff192c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3015 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.588267:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584846.588269:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784584846.588273:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819c00/0x787d778cc3ff1f53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31c0 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.588283:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584846.588286:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584846.588289:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2600/0x787d778cc3ff188b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2fe4 expref: 10 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.588300:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff97c7c58a0100) 00010000:00010000:0.0:1784584846.588308:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784584846.588313:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c801819a00/0x787d778cc3ff18b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2ff2 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.588331:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584846.588334:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584846.588338:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff1f29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31b2 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584846.588351:0:5793:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97c7c5ee2000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1784584846.588365:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584846.588367:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584846.588369:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584846.619853:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784584846.922963:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1784584846.922989:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000001:00080000:1.0:1784584846.922995:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1784584846.922998:0:5828:0:(genops.c:906:class_export_put()) final put ffff97c7c5ee2000/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:3.0:1784584846.923180:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c5ee2000/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 for lustre-MDT0000 00000020:00000080:3.0:1784584846.923422:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7c5ee5000 for lustre-MDT0000 00000001:00100000:0.0:1784584846.933116:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:0.0:1784584846.933124:0:6631:0:(genops.c:906:class_export_put()) final put ffff97c7d8a4d800/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:3.0:1784584846.933291:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d8a4d800/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 for lustre-OST0000 00000020:00000080:3.0:1784584846.933408:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7d8a4b000 for lustre-OST0000 00000100:00100000:3.0:1784584847.299092:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584847.299153:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584847.299189:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549128448 00000100:00100000:1.0:1784584847.299200:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549128448 00000100:00100000:1.0:1784584847.299279:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00100000:1.0:1784584847.299291:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+6:2356:x1871272549128448:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584847.299368:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ec120a06-153f-439e-85c8-b41da9afb57f+6:2356:x1871272549128448:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 79us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584847.299377:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 159 00000100:00080000:3.0:1784584847.299394:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584847.299468:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549128320 00000100:00100000:2.0:1784584847.299473:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549128320 00000100:00100000:2.0:1784584847.300065:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 296 00000100:00100000:2.0:1784584847.300077:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549128320:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584847.300130:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549128320:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 57us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584847.300138:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 296 00010000:00010000:0.0:1784584847.643929:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784584847.963970:0:11550:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784584847.963979:0:11550:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784584847.964491:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1784584847.964498:0:11550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784584848.039985:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584848.040043:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584848.040082:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584848.040147:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549128704 00000100:00100000:0.0:1784584848.040169:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549128704 00000100:00100000:2.0:1784584848.040204:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549128576 00000100:00100000:2.0:1784584848.040214:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549128576 00000100:00100000:0.0:1784584848.040262:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549128832 00000100:00100000:0.0:1784584848.040268:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549128832 00000100:00100000:2.0:1784584848.040274:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:2.0:1784584848.040290:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2479180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:2356:x1871272549128704:12345-192.168.203.52@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1784584848.040310:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00010000:00010000:2.0:1784584848.040311:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1784584848.040325:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2479f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+12:2356:x1871272549128576:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584848.040345:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7faaec200/0x787d778cc3ff103b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d98 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584848.040352:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584848.040375:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584848.040381:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf400/0x787d778cc3ff1034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d6e expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584848.040421:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584848.040450:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2479180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+10:2356:x1871272549128704:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 161us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584848.040459:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1784584848.040483:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2479f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:2356:x1871272549128576:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 158us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584848.040493:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1784584848.040502:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+9:2356:x1871272549128832:12345-192.168.203.52@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1784584848.040511:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00010000:00010000:2.0:1784584848.040513:0:8317:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584848.040531:0:8317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c801819800/0x787d778cc3ff11d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2e1d expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584848.040545:0:8317:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584848.040586:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124465d0-a979-47fc-b1e9-56d9fa9a31c6+7:2356:x1871272549128832:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 84us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584848.040593:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1784584848.052726:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584848.052823:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549129088 00000100:00100000:3.0:1784584848.052836:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549129088 00000100:00100000:3.0:1784584848.052919:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:3.0:1784584848.052932:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+6:2353:x1871272549129088:12345-192.168.203.52@tcp:39:umount.0 00000020:00000080:3.0:1784584848.052984:0:5808:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff1049 00000020:00010000:3.0:1784584848.052994:0:5808:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97c7efc0a000: total 0 00000100:00080000:3.0:1784584848.053000:0:5808:0:(import.c:65:import_set_state_nolock()) ffff97c7efc08000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784584848.053038:0:5808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1784584848.053101:0:5794:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97c7efc0a000: total 0 00010000:00010000:0.0:1784584848.053184:0:5794:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97c7efc0a000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1784584848.053227:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189cc00) 00010000:00010000:0.0:1784584848.053232:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584848.053255:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff1f76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ce expref: 5 pid: 6997 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584848.053288:0:5794:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97c7efc0a000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1784584848.053303:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584848.053307:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584848.053309:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584848.053574:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ec120a06-153f-439e-85c8-b41da9afb57f+3:2353:x1871272549129088:12345-192.168.203.52@tcp:39:umount.0 Request processed in 641us (894us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1784584848.053585:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 241 00000100:00100000:1.0:1784584848.073298:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584848.073432:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549129344 00000100:00100000:0.0:1784584848.073445:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549129344 00000100:00100000:0.0:1784584848.073517:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 297 00000100:00100000:0.0:1784584848.073528:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+7:2353:x1871272549129344:12345-192.168.203.52@tcp:251:umount.0 00000020:00000080:0.0:1784584848.073589:0:5799:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0f3f 00000020:00010000:0.0:1784584848.073599:0:5799:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97c7faad9000: total 0 00000100:00080000:0.0:1784584848.073605:0:5799:0:(import.c:65:import_set_state_nolock()) ffff97c7faada000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784584848.073987:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:124465d0-a979-47fc-b1e9-56d9fa9a31c6+3:2353:x1871272549129344:12345-192.168.203.52@tcp:251:umount.0 Request processed in 459us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584848.073997:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 297 00000020:00010000:3.0:1784584848.074486:0:5793:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97c7faad9000: total 0 00010000:00010000:3.0:1784584848.074492:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584848.074550:0:5793:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97c7faad9000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1784584848.074594:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7faaeda00/0x787d778cc3ff0f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb2d60 expref: 2 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584848.074633:0:5793:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97c7faad9000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1784584848.074645:0:5793:0:(genops.c:906:class_export_put()) final put ffff97c7faad9000/124465d0-a979-47fc-b1e9-56d9fa9a31c6 00010000:00010000:3.0:1784584848.074669:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584848.074671:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584848.074673:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784584848.075273:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7faad9000/124465d0-a979-47fc-b1e9-56d9fa9a31c6 for MGS 00000020:00000080:0.0:1784584848.075334:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7faada000 for MGS 00000100:00100000:1.0:1784584848.413548:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784584848.413576:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569025152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584848.413644:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584848.413955:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569025152 00000100:00100000:0.0:1784584848.413964:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569025152 00000100:00100000:0.0:1784584848.414119:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784584848.414128:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569025152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1784584848.414170:0:6609:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784584848.414220:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569025152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584848.414228:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784584848.414452:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569025152:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1784584848.415194:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1784584848.443572:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:0.0:1784584848.443581:0:7511:0:(genops.c:906:class_export_put()) final put ffff97c7fbe4a800/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 00000020:00000080:0.0:1784584848.443603:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7fbe4a800/4bc8dc1e-939f-43d0-b7e8-92b33f45a3a2 for lustre-OST0001 00000020:00000080:0.0:1784584848.443638:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7fbe49800 for lustre-OST0001 00010000:00010000:2.0:1784584848.669805:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584849.694790:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784584849.697903:0:12935:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784584849.716360:0:12935:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1784584849.716411:0:12935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584849.716427:0:12935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584849.716434:0:12935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584849.716441:0:12935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584849.716510:0:12935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784584849.716515:0:12935:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784584849.716539:0:12935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784584849.716543:0:12935:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1784584849.716548:0:12935:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784584849.716572:0:12935:0:(import.c:65:import_set_state_nolock()) ffff97c8010b3000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1784584849.719357:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584849.719368:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584849.719380:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166f400 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1784584849.719394:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584849.719406:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584849.719413:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584849.719419:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784584849.719421:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784584849.719425:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784584849.719462:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584849.719469:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784584849.719528:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569025408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584849.719596:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584849.719791:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569025408 00000100:00100000:0.0:1784584849.719798:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569025408 00000100:00100000:0.0:1784584849.719853:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784584849.719861:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+19:3323:x1871272569025408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584849.719873:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584849.719887:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fda00/0x787d778cc3ff0fd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0fd2 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584849.719901:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584849.719972:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584849.719981:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166f400/0x787d778cc3ff0fd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fd9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584849.719992:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584849.719994:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584849.719996:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584849.722295:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c247a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272569025280:0@lo:39:umount.0 00000100:00100000:2.0:1784584849.722361:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584849.722571:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569025280 00000100:00100000:2.0:1784584849.722578:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569025280 00000100:00100000:2.0:1784584849.722621:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1784584849.722628:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871272569025280:12345-0@lo:39:umount.0 00000020:00000080:2.0:1784584849.722653:0:6997:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0d4e 00000100:00080000:2.0:1784584849.722661:0:6997:0:(import.c:65:import_set_state_nolock()) ffff97c801b34800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1784584849.722729:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3319:x1871272569025280:12345-0@lo:39:umount.0 Request processed in 101us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584849.722736:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1784584849.722745:0:6997:0:(genops.c:906:class_export_put()) final put ffff97c801b34000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1784584849.722765:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c801b34000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784584849.722815:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c801b34800 for lustre-MDT0000 00000100:00080000:2.0:1784584849.722843:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c8010b3000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1784584849.722854:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c247a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272569025280:0@lo:39:umount.0 00010000:00010000:2.0:1784584849.722874:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584849.722893:0:12935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784584849.722896:0:12935:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1784584849.722900:0:12935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1784584849.723816:0:12935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723848:0:12935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723856:0:12935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723863:0:12935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723880:0:12935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584849.723886:0:12935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723893:0:12935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723899:0:12935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723905:0:12935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723917:0:12935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784584849.723927:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584849.723932:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723940:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166e000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584849.723949:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.723958:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584849.723965:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584849.723972:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784584849.723974:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1784584849.724001:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724007:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584849.724033:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724040:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166e000/0x787d778cc3ff0fe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fe7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724054:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584849.724057:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724063:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c1512200 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584849.724066:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724072:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584849.724089:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584849.724094:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784584849.724096:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1784584849.724098:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1784584849.724111:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584849.724112:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724117:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584849.724123:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724129:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c1512200/0x787d778cc3ff0ef9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0f00 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724141:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584849.724388:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569025536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584849.724441:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584849.724486:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784584849.724491:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569025664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584849.724512:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584849.724578:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569025536 00000100:00100000:3.0:1784584849.724585:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569025664 00000100:00100000:1.0:1784584849.724585:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569025536 00000100:00100000:3.0:1784584849.724588:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569025664 00000100:00100000:1.0:1784584849.724622:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1784584849.724627:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584849.724629:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584849.724630:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+20:3320:x1871272569025536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584849.724641:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584849.724643:0:12935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724651:0:12935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724658:0:12935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724664:0:12935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724685:0:12935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584849.724706:0:12935:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724713:0:12935:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724719:0:12935:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724726:0:12935:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724735:0:12935:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1784584849.724739:0:12935:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1784584849.724743:0:12935:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:1.0:1784584849.724751:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff0fe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0fe0 expref: 20 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584849.724762:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584849.724765:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584849.724768:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724774:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3a00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584849.724777:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724783:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584849.724790:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584849.724793:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+19:3320:x1871272569025536:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584849.724801:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 10000000:01000000:2.0:1784584849.724804:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784584849.724807:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784584849.724808:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:1.0:1784584849.724816:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1784584849.724822:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584849.724822:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8a81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+18:3320:x1871272569025664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584849.724828:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584849.724829:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584849.724836:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1512400/0x787d778cc3ff0f00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0ef9 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724841:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584849.724846:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584849.724847:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa3a00/0x787d778cc3ff11fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff1202 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724854:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584849.724857:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.724863:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166e200 already unused, calling callback (ffffffffc1d99c20) 00000100:00100000:1.0:1784584849.724864:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8a81050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+17:3320:x1871272569025664:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (351us total) trans 0 rc 0/0 10000000:00010000:2.0:1784584849.724866:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584849.724870:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1784584849.724873:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584849.724879:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584849.724884:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784584849.724886:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1784584849.724887:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1784584849.724944:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c4006421-7015-489e-aaaa-81e9219afdea+16:3323:x1871272569025408:12345-0@lo:103:ldlm_bl.0 Request processed in 5082us (5347us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584849.724952:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1784584849.725032:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.725039:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584849.725046:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.725052:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166e200/0x787d778cc3ff0cad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0cb4 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584849.725063:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584849.725064:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584849.725066:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784584849.725078:0:12935:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1784584849.725083:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1784584849.725086:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784584849.725092:0:12935:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1784584849.725096:0:12935:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97c7d87ab000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784584849.725102:0:12935:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff97c7c7f3a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784584849.725109:0:12935:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff97c7efc0a000 ec120a06-153f-439e-85c8-b41da9afb57f 192.168.203.52@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784584849.725115:0:12935:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff97c7c5d499c0) has exports, disconnecting them 00000020:00080000:2.0:1784584849.725119:0:12935:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97c7d87ab000), last request at 1784584846 00000020:00000080:2.0:1784584849.725125:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0ec1 00000100:00080000:2.0:1784584849.725139:0:12935:0:(import.c:65:import_set_state_nolock()) ffff97c7d87ac000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1784584849.725183:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784584849.725194:0:12935:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c7d87ab000): rc 0 00000020:00000080:2.0:1784584849.725196:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7d87ab000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1784584849.725205:0:12935:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97c7c7f3a000), last request at 1784584846 00000020:00000080:2.0:1784584849.725208:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0df6 00000100:00080000:2.0:1784584849.725218:0:12935:0:(import.c:65:import_set_state_nolock()) ffff97c8019f1000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1784584849.725231:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d87ab000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1784584849.725265:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7d87ac000 for lustre-MDT0000 00010000:00010000:2.0:1784584849.725276:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784584849.725284:0:12935:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c7c7f3a000): rc 0 00000020:00000080:2.0:1784584849.725286:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7c7f3a000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1784584849.725296:0:12935:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb02342b17ae0 00000020:00000080:2.0:1784584849.725306:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c7f3a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1784584849.725329:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c8019f1000 for lustre-MDT0000 00000100:00080000:2.0:1784584849.725351:0:12935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784584849.725354:0:12935:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1784584849.725367:0:12935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1784584849.725443:0:12935:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1784584849.725456:0:12935:0:(import.c:65:import_set_state_nolock()) ffff97c7f3d4f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1784584849.725468:0:12935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784584849.725470:0:12935:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1784584849.725480:0:12935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784584849.725554:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569026048:0@lo:9:umount.0 00000100:00100000:2.0:1784584849.725590:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1784584849.725622:0:12935:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1784584849.725631:0:12935:0:(import.c:65:import_set_state_nolock()) ffff97c7faadd000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1784584849.725647:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569026176:0@lo:9:umount.0 00000100:00100000:2.0:1784584849.725670:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584849.725716:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569026048 00000100:00100000:2.0:1784584849.725722:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569026048 00000100:00100000:2.0:1784584849.725757:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569026176 00000100:00100000:2.0:1784584849.725760:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569026176 00000100:00100000:2.0:1784584849.725784:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784584849.725790:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1871272569026048:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784584849.725815:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0e51 00000100:00080000:2.0:1784584849.725821:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7f3d4d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784584849.725846:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1784584849.726158:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3319:x1871272569026048:12345-0@lo:9:umount.0 Request processed in 353us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584849.726166:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1784584849.726179:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784584849.726186:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1871272569026176:12345-0@lo:9:umount.0 00000020:00000080:2.0:1784584849.726196:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0f2a 00000100:00080000:2.0:1784584849.726201:0:6605:0:(import.c:65:import_set_state_nolock()) ffff97c7faadc000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784584849.726214:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1784584849.726398:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3319:x1871272569026176:12345-0@lo:9:umount.0 Request processed in 211us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584849.726404:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1784584849.726420:0:5802:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584849.726446:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7faadd000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784584849.726450:0:3319:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784584849.726452:0:3319:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784584849.726456:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569026176:0@lo:9:umount.0 00000100:00080000:2.0:1784584849.726465:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7f3d4f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1784584849.726471:0:3319:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1784584849.726473:0:3319:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784584849.726475:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569026048:0@lo:9:umount.0 00010000:00010000:2.0:1784584849.726498:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1784584849.726529:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff97c7c5d499c0) has no exports 00000100:00100000:2.0:1784584849.726800:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569025664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584849.726810:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569025536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584849.726845:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569025408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584849.726860:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569025920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584849.726892:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584849.731535:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569025920 00000100:00100000:1.0:1784584849.731550:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569025920 00000100:00100000:1.0:1784584849.731603:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1784584849.731613:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+16:3323:x1871272569025920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584849.731630:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1784584849.731769:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569025792:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584849.731791:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1513a00/0x787d778cc3ff0cb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0cad expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584849.731815:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584849.731850:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584849.731855:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c4006421-7015-489e-aaaa-81e9219afdea+15:3323:x1871272569025920:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (4962us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584849.731878:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784584849.732110:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584849.732161:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569025792 00000100:00100000:0.0:1784584849.732167:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569025792 00000100:00100000:0.0:1784584849.732202:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784584849.732217:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+15:3322:x1871272569025792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584849.732226:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584849.732239:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff1202 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff11fb expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584849.732250:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584849.732453:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c4006421-7015-489e-aaaa-81e9219afdea+14:3322:x1871272569025792:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584849.732460:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784584849.732579:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569025792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584849.732851:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569025920:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1784584849.738364:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff97c7c5d499c0) has no exports 00000020:00000080:2.0:1784584849.800970:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0d08 00000020:00000080:2.0:1784584849.800988:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7d87a9000/lustre-QMT0000_UUID 00000020:01000000:2.0:1784584849.801255:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1784584849.801482:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584849.801494:0:12935:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784584849.801499:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff97c7fbd04d40) has no exports 00000020:00000080:3.0:1784584849.801870:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0d01 00000020:00000080:3.0:1784584849.801877:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c8019f4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784584849.801973:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d87a9000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1784584849.804077:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584849.804091:0:12935:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1784584849.804096:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c8019f5800/lustre-QMT0000_UUID 00000020:00000080:3.0:1784584849.804101:0:12935:0:(genops.c:865:class_export_destroy()) destroying export ffff97c8019f5800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1784584849.804110:0:12935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1784584849.807009:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c8019f4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1784584850.716013:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584851.484150:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569026560:0@lo:400:kworker.0 00000100:00100000:3.0:1784584851.484170:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272569026432:0@lo:400:kworker.0 00000100:00100000:2.0:1784584851.484225:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569026304:0@lo:400:kworker.0 00000100:00100000:3.0:1784584851.484289:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584851.484338:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584851.484388:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569026304 00000100:00100000:2.0:1784584851.484395:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569026304 00000100:00100000:0.0:1784584851.484396:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584851.484451:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1784584851.484460:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:3320:x1871272569026304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584851.484509:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d033d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c4006421-7015-489e-aaaa-81e9219afdea+14:3320:x1871272569026304:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584851.484516:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1784584851.484530:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4257b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569026304:0@lo:400:kworker.0 00000100:00100000:1.0:1784584851.484868:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569026432 00000100:00100000:1.0:1784584851.484873:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569026432 00000100:00100000:1.0:1784584851.484906:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569026560 00000100:00100000:1.0:1784584851.484909:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569026560 00000100:00100000:1.0:1784584851.484931:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1784584851.484936:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3321:x1871272569026432:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784584851.484942:0:5808:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784584851.484981:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3321:x1871272569026432:12345-0@lo:400:kworker.0 Request processed in 44us (692us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784584851.484988:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1784584851.485008:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1784584851.485012:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1871272569026560:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1784584851.485016:0:5808:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1784584851.485040:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4254a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1871272569026560:12345-0@lo:400:kworker.0 Request processed in 26us (643us total) trans 0 rc -107/-107 00000100:00100000:1.0:1784584851.485045:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1784584851.485070:0:3321:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1784584851.485075:0:3321:0:(import.c:65:import_set_state_nolock()) ffff97c7ffc53000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1784584851.485079:0:3321:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784584851.486158:0:3322:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784584851.486164:0:3322:0:(import.c:65:import_set_state_nolock()) ffff97c7fcece800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1784584851.486167:0:3322:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1784584851.486173:0:3322:0:(import.c:65:import_set_state_nolock()) ffff97c7fcece800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584851.486177:0:3322:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 173 00000100:00080000:0.0:1784584851.486185:0:3322:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97c7fcece800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1784584851.486215:0:3322:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f4256d80 x1871272569026688/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584851.486244:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569026560:0@lo:400:kworker.0 00000100:00100000:2.0:1784584851.486310:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1871272569026688:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1784584851.486352:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584851.486401:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569026688 00000100:00100000:3.0:1784584851.486407:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569026688 00000100:00100000:3.0:1784584851.486476:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1784584851.486490:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1871272569026688:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1784584851.486530:0:5808:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1784584851.496335:0:3321:0:(import.c:65:import_set_state_nolock()) ffff97c7ffc53000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784584851.496345:0:3321:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 157 00000100:00080000:1.0:1784584851.496355:0:3321:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97c7ffc53000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1784584851.496391:0:3321:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8010bf800 x1871272569026816/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584851.496491:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1871272569026816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1784584851.496556:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584851.496652:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272569026432:0@lo:400:kworker.0 00000100:00100000:0.0:1784584851.497169:0:6997:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569026816 00000100:00100000:0.0:1784584851.497178:0:6997:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569026816 00000100:00100000:0.0:1784584851.497216:0:6997:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1784584851.497233:0:6997:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3319:x1871272569026816:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1784584851.497250:0:6997:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1784584851.497606:0:6997:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3319:x1871272569026816:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 371us (1047us total) trans 0 rc -19/-19 00000100:00100000:0.0:1784584851.497613:0:6997:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1784584851.498336:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7ffc53000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584851.498343:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784584851.498347:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1871272569026816:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1784584851.510331:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1871272569026688:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 23835us (23972us total) trans 0 rc -19/-19 00000100:00100000:3.0:1784584851.510345:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:2.0:1784584851.510357:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7fcece800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584851.510363:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1784584851.510367:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1871272569026688:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1784584851.740032:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1784584852.049010:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ec120a06-153f-439e-85c8-b41da9afb57f 00000001:00080000:3.0:1784584852.049026:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1784584852.049033:0:5828:0:(genops.c:906:class_export_put()) final put ffff97c7efc0a000/ec120a06-153f-439e-85c8-b41da9afb57f 00000020:00000080:0.0:1784584852.049396:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7efc0a000/ec120a06-153f-439e-85c8-b41da9afb57f for lustre-MDT0000 00000020:00000080:0.0:1784584852.049461:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7efc08000 for lustre-MDT0000 00000001:00100000:1.0:1784584852.051575:0:12611:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784584852.051584:0:12611:0:(genops.c:906:class_export_put()) final put ffff97c7f3d4b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784584852.051813:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7f3d4b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1784584852.051862:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7f3d4d000 for lustre-OST0000 00010000:00010000:3.0:1784584852.764103:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784584853.607518:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784584853.607527:0:7511:0:(genops.c:906:class_export_put()) final put ffff97c7faadb000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784584853.607605:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7faadb000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1784584853.607659:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7faadc000 for lustre-OST0001 00010000:00010000:3.0:1784584853.789271:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584854.812234:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584855.836014:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1784584855.899794:0:12935:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97c7efc18c00 - data ffff97c7c83a6438/ffff97c7faaf6c00 00000020:01000000:3.0:1784584855.900028:0:12935:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97c7d8773ba0 - data ffff97c7c825a438/ffff97c7d13bcc00 00000001:00000004:3.0:1784584855.905329:0:12935:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1784584855.979971:0:12935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784584855.979979:0:12935:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1784584855.980492:0:12935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784584855.980496:0:12935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1784584855.985983:0:6995:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1784584855.985993:0:6995:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1784584855.986009:0:6995:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1784584855.987664:0:12935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1784584855.987671:0:12935:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1784584855.987720:0:12935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784584855.987723:0:12935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784584855.989590:0:7983:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784584855.989598:0:7983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1784584855.989611:0:7983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1784584856.035099:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0cd0 00000020:00000080:3.0:1784584856.035126:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7d1405800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784584856.035722:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d1405800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784584856.037140:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0ce5 00000020:00000080:3.0:1784584856.037153:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7c3dd9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1784584856.037206:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1784584856.037219:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584856.037226:0:12935:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784584856.037230:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff97c801b20000) has no exports 00000004:01000000:3.0:1784584856.037422:0:12935:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1784584856.037440:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0f23 00000020:00000080:3.0:1784584856.037445:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c801aee800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784584856.037533:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c3dd9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784584856.037589:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784584856.037593:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584856.037600:0:12935:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784584856.037603:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff97c7c5c63380) has no exports 00000020:00000080:3.0:1784584856.037611:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0f1c 00000020:00000080:3.0:1784584856.037615:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7faadd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784584856.037637:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c801aee800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1784584856.039011:0:12935:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784584856.039018:0:12935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1784584856.039022:0:12935:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1784584856.039029:0:12935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784584856.039031:0:12935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584856.039146:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7faadd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784584856.039234:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584856.039245:0:12935:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784584856.039252:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0e3c 00000020:00000080:3.0:1784584856.039259:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7ffc93800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784584856.039283:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7faadd000 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1784584856.039288:0:36:0:(genops.c:906:class_export_put()) final put ffff97c7faadf000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784584856.039290:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7faadf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1784584856.039294:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784584856.039417:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1784584856.039422:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584856.039496:0:12935:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784584856.039501:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff97c801b219c0) has no exports 00000020:00000080:3.0:1784584856.039507:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0e35 00000020:00000080:3.0:1784584856.039511:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7f3d48000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784584856.039533:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7ffc93800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1784584856.040171:0:12935:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1784584856.040175:0:12935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1784584856.040179:0:12935:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1784584856.040183:0:12935:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784584856.040185:0:12935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584856.040237:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7f3d48000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1784584856.040319:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584856.040326:0:12935:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784584856.040351:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584856.040354:0:12935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784584856.040357:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c8010b7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1784584856.040359:0:12935:0:(genops.c:865:class_export_destroy()) destroying export ffff97c8010b7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1784584856.040367:0:12935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1784584856.040590:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0cec 00000020:00000080:3.0:1784584856.040596:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7c3ddd000/lustre-MDD0000_UUID 00000020:00000080:0.0:1784584856.040641:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7f3d4f800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1784584856.040647:0:36:0:(genops.c:906:class_export_put()) final put ffff97c801b35800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784584856.040649:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c801b35800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1784584856.040655:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1784584856.041013:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1784584856.041018:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584856.041023:0:12935:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1784584856.041026:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff97c7c5d4cd40) has no exports 00000020:00000080:3.0:1784584856.041045:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584856.041049:0:12935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1784584856.041053:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0cf3 00000020:00000080:3.0:1784584856.041057:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7c3dd8800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1784584856.041078:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c3ddd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1784584856.041082:0:36:0:(genops.c:906:class_export_put()) final put ffff97c7c7d7c000/lustre-MDD0000_UUID 00000020:00000080:0.0:1784584856.041083:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c7d7c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1784584856.041088:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:3.0:1784584856.041286:0:12935:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c7d687f000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1784584856.041290:0:12935:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7d687f000 3 00000020:01000004:3.0:1784584856.041293:0:12935:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97c7d687f000 from lustre-MDT0000 00000020:00000080:3.0:1784584856.041313:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584856.041317:0:12935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1784584856.041320:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7d1401800/lustre-MDT0000_UUID 00000020:00000080:3.0:1784584856.041322:0:12935:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d1401800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1784584856.041327:0:12935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1784584856.041356:0:12935:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1784584856.041359:0:12935:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1784584856.041362:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1784584856.041364:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584856.041367:0:12935:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784584856.041373:0:12935:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff97c7d87a1800 c4006421-7015-489e-aaaa-81e9219afdea 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784584856.041378:0:12935:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff97c7c7f88000) has exports, disconnecting them 00000020:00080000:3.0:1784584856.041390:0:12935:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97c7d87a1800), last request at 1784584646 00000020:00000080:3.0:1784584856.041404:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0c91 00000020:00010000:3.0:1784584856.041407:0:12935:0:(genops.c:1942:obd_stale_export_put()) Put export ffff97c7d87a1800: total 1 00000100:00080000:3.0:1784584856.041411:0:12935:0:(import.c:65:import_set_state_nolock()) ffff97c7d87a6800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1784584856.041527:0:12935:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c7d87a1800): rc 0 00000020:00080000:3.0:1784584856.041532:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff97c7c7f88000) has no exports 00000100:00100000:3.0:1784584856.041583:0:5799:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff97c7e035ca00:5799] 1 exiting: rc = 0 00000100:00100000:3.0:1784584856.041744:0:5798:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff97c7e035ce00:5798] 0 exiting: rc = 1 00000100:00100000:2.0:1784584856.041928:0:5800:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff97c7d0770600:5800] 2 exiting: rc = 0 00000020:00010000:1.0:1784584856.042013:0:5793:0:(genops.c:1928:obd_stale_export_get()) Get export ffff97c7d87a1800: total 1 00010000:00010000:1.0:1784584856.042048:0:5793:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff97c7d87a1800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1784584856.042081:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c801818400/0x787d778cc3ff11e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff11df expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584856.042096:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fdc00/0x787d778cc3ff0ff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0fee expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584856.042116:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c801819400/0x787d778cc3ff11f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff11ed expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584856.042130:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c1512600/0x787d778cc3ff0da9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0da2 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584856.042142:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c13fca00/0x787d778cc3ff0fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0f9a expref: 5 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584856.042152:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bec00/0x787d778cc3ff0faf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0fa8 expref: 4 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584856.042162:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c166e400/0x787d778cc3ff0fbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0fb6 expref: 3 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584856.042190:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7faaec800/0x787d778cc3ff0fcb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x787d778cc3ff0fc4 expref: 2 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584856.042203:0:5793:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff97c7d87a1800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1784584856.042215:0:5793:0:(genops.c:906:class_export_put()) final put ffff97c7d87a1800/c4006421-7015-489e-aaaa-81e9219afdea 00000020:00000080:0.0:1784584856.042250:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c3dd8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1784584856.042297:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042304:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042310:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042315:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042321:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042326:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042331:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042336:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042342:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042347:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042353:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042358:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042363:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042369:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042374:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042379:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042385:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042389:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042395:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042399:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042404:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042410:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042416:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042422:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042505:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042517:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042522:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042528:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042533:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042537:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042543:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042548:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042553:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042558:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042563:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042568:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042573:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042578:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042583:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042588:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042594:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042600:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042605:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042609:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042614:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042619:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042624:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042686:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042777:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042855:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042861:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042866:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042871:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042876:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042949:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042957:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042962:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042967:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042972:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042977:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042992:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.042997:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.043003:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.043008:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1784584856.043404:0:12935:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784584856.043409:0:12935:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1784584856.043575:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584856.043578:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584856.043581:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784584856.044556:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d87a1800/c4006421-7015-489e-aaaa-81e9219afdea for MGS 00000020:00000080:0.0:1784584856.044815:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7d87a6800 for MGS 00000020:01000000:1.0:1784584856.045026:0:12935:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97c7c53220c0 - data ffff97c7ffe72a20/ffff97c7f426cc00 00000020:01000000:1.0:1784584856.045137:0:12935:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97c7c5fe2240 - data ffff97c7e6f6f6c0/ffff97c7c7f60c00 00000020:00000080:1.0:1784584856.045959:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0c75 00000020:00000080:1.0:1784584856.045967:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7d0349800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1784584856.046023:0:12935:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c7d687f000 from MGS, refs=2 00000020:01000004:1.0:1784584856.046027:0:12935:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7d687f000 2 00000020:01000004:1.0:1784584856.046031:0:12935:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97c7d687f000 from MGS 00000020:00000080:1.0:1784584856.046052:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584856.046058:0:12935:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1784584856.046061:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7d034f000/MGS 00000020:00000080:1.0:1784584856.046063:0:12935:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d034f000/MGS for MGS 00000020:01000000:1.0:1784584856.046073:0:12935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1784584856.046138:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1784584856.046143:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584856.046149:0:12935:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1784584856.046155:0:12935:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97c801b30000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784584856.046161:0:12935:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff97c7d8a7cd40) has exports, disconnecting them 00000020:00080000:1.0:1784584856.046166:0:12935:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97c801b30000), last request at 1784584647 00000020:00000080:1.0:1784584856.046170:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0d40 00000020:00080000:1.0:1784584856.046181:0:12935:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c801b30000): rc 0 00000020:00000080:1.0:1784584856.046185:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c801b30000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784584856.046288:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d0349800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784584856.047338:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c801b30000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784584856.050548:0:12935:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784584856.050555:0:12935:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584856.050559:0:12935:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784584856.050566:0:12935:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584856.050601:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c8010b3000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784584856.050765:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584856.050774:0:12935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1784584856.050779:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7d87ad800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1784584856.050952:0:12935:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d87ad800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1784584856.050958:0:12935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784584856.051017:0:12935:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7d687f000 1 00000020:00000080:0.0:1784584856.051023:0:12935:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0c67 00000020:00000080:0.0:1784584856.051030:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7d0348000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784584856.051038:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784584856.051046:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d0348000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784584856.051056:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584856.051061:0:12935:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784584856.051064:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff97c7d8a799c0) has no exports 00000020:00000080:3.0:1784584856.087144:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584856.087156:0:12935:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1784584856.087163:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7d6878800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1784584856.087167:0:12935:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d6878800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1784584856.087176:0:12935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1784584856.087292:0:12935:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97c7d687d800 00000020:01000000:3.0:1784584856.087313:0:12935:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1784584856.087317:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584856.087321:0:12935:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1784584856.087326:0:12935:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff97c7c5d48000) has no exports 00000100:00100000:3.0:1784584856.087386:0:5808:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff97c7c41ad200:5808] 2 exiting: rc = 0 00000100:00100000:3.0:1784584856.090462:0:5807:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff97c7c64d4600:5807] 1 exiting: rc = 0 00000100:00100000:3.0:1784584856.090993:0:6997:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff97c7f45bd400:6997] 3 exiting: rc = 0 00000100:00100000:3.0:1784584856.091084:0:5806:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff97c7c64d4200:5806] 0 exiting: rc = 1 00000100:00100000:0.0:1784584856.091853:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.091861:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092041:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092047:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092052:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092057:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092062:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092067:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092072:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092078:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092083:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092088:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092094:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092099:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092118:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092125:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092130:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092134:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092139:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092144:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092150:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092156:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092161:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092166:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092171:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092176:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092182:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092188:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092194:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092199:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092204:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092209:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092215:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092220:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092225:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092231:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092236:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092251:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092256:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092262:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092267:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092273:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092278:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092284:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092289:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092295:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092299:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092305:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092310:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092315:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092320:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092325:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092331:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092337:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092342:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092347:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092354:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092360:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092366:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092371:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092377:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092382:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092387:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.092392:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.097857:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff97c7c41ade00:5809] 0 exiting: rc = 1 00000100:00100000:2.0:1784584856.098530:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff97c7c41ad600:5810] 1 exiting: rc = 0 00000100:00100000:0.0:1784584856.098734:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.098742:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.098747:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.098753:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.098758:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.098763:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.098769:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099071:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099077:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099082:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099088:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099094:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099110:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099116:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099122:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099127:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099132:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099136:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099141:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099147:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099153:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099157:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099163:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099168:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099174:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099179:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099184:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099189:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099194:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099198:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099203:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099208:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099212:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099217:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099222:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099226:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099231:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099236:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099240:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099245:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099249:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099254:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099266:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099271:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099275:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099280:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099287:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099292:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099298:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099304:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099310:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099314:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099320:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099324:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099329:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099334:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099338:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099343:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099347:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099351:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099356:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099361:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099368:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.099373:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.100239:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff97c7d072ae00:5812] 1 exiting: rc = 0 00000100:00100000:3.0:1784584856.100333:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff97c7d072aa00:5811] 0 exiting: rc = 1 00000100:00100000:0.0:1784584856.100376:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100383:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100388:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100393:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100399:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100404:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100421:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100439:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100445:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100450:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100455:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100460:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100465:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100481:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100487:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100493:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100498:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100503:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100522:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100529:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100535:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100541:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100548:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100554:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100559:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100564:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100570:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100575:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100580:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100587:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100607:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100614:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100620:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100625:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100640:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100646:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100652:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100658:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100663:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100668:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100674:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100679:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100718:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100726:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100731:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100737:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100744:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100749:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.100762:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101022:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101029:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101114:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101124:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101129:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101154:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101160:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101166:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101172:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101177:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101183:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101192:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101200:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101207:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.101213:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.112561:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97c7d072a800:5813] 0 exiting: rc = 1 00000100:00100000:0.0:1784584856.112763:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff97c7c40be800:5814] 1 exiting: rc = 0 00000100:00100000:3.0:1784584856.112864:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.112871:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.112991:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.112997:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113003:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113009:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113015:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113019:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113025:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113030:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113048:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113054:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113059:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113065:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113070:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113075:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113081:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113086:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113092:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113097:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113110:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113116:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113122:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113127:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113133:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113138:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113143:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113148:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113152:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113157:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113163:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113167:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113172:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113178:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113183:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113187:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113193:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113198:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113203:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113208:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113213:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113218:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113223:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113228:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113233:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113245:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113250:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113255:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113261:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113266:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113271:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113276:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113281:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113287:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113292:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113297:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113302:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113308:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113313:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113317:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113322:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113328:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113333:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.113338:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.113810:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff97c7c40bfe00:5816] 1 exiting: rc = 0 00000100:00100000:2.0:1784584856.114527:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff97c7c40bf400:5815] 0 exiting: rc = 1 00000100:00100000:3.0:1784584856.114602:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114608:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114613:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114618:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114622:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114635:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114641:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114645:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114650:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114654:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114659:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114663:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114668:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114672:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114677:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.114681:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115139:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115144:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115150:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115155:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115161:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115166:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115171:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115177:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115181:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115186:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115191:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115195:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115200:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115204:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115208:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115214:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115218:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115222:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115227:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115231:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115236:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115241:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115246:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115252:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115256:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115261:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115265:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115270:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115275:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115279:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115284:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115290:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115295:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115299:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115305:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115320:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115325:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115329:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115334:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115338:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115343:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115347:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115352:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115356:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115361:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115365:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115369:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.115374:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584856.116067:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff97c7c40bf800:5818] 1 exiting: rc = 0 00000100:00100000:2.0:1784584856.117682:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff97c7c40be600:5817] 0 exiting: rc = 1 00000100:00100000:0.0:1784584856.117789:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117796:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117801:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117805:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117809:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117814:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117819:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117823:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117828:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117832:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117836:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117840:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117845:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117849:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117854:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117859:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117863:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117889:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117894:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117898:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117903:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117907:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117912:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117921:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117932:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117937:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117942:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117947:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117952:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117957:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117961:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117966:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117971:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117975:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117980:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117984:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117990:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.117995:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118000:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118004:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118008:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118012:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118017:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118021:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118026:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118031:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118035:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118040:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118045:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118050:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118055:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118059:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118071:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118075:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118080:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118084:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118089:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118094:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118098:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118113:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118118:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118123:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118128:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118133:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584856.118587:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff97c7d072be00:5821] 2 exiting: rc = 0 00000100:00100000:1.0:1784584856.119828:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff97c7d072b600:5819] 0 exiting: rc = 1 00000100:00100000:1.0:1784584856.120097:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff97c7d072b400:5820] 1 exiting: rc = 0 00000100:00100000:1.0:1784584856.142514:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142526:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142533:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142540:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142548:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142556:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142563:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142570:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142578:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142585:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142598:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142605:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142612:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142617:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142623:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142647:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142654:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142660:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142665:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142671:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142676:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142682:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.142688:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143053:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143062:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143071:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143079:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143086:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143093:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143109:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143117:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143122:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143128:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143147:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143152:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143157:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143163:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143168:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143175:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143195:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143202:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143207:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143214:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143218:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143223:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143228:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143235:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143240:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143246:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143251:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143257:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143262:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143268:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143347:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143356:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143364:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143371:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143379:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143388:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143399:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143406:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143413:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143418:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584856.143561:0:12935:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1784584856.151386:0:12935:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584856.151399:0:12935:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1784584856.151404:0:12935:0:(genops.c:906:class_export_put()) final put ffff97c7c4fc0800/MDS_uuid 00000020:00000080:1.0:1784584856.151409:0:12935:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c4fc0800/MDS_uuid for MDS 00000020:01000000:1.0:1784584856.151501:0:12935:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1784584856.151649:0:12935:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:0.0:1784584856.603983:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784584856.603992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784584856.603997:0:36:0:(import.c:65:import_set_state_nolock()) ffff97c7ffc53000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584856.604007:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 346 00000100:00080000:0.0:1784584856.604014:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784584856.604021:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97c7ffc53000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1784584856.604033:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784584856.604054:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569026944:0@lo:400:kworker.0 00000400:00000100:0.0:1784584856.604136:0:3322:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871272569026944 offset 0 length 224: 4 00000100:00100000:0.0:1784584856.604240:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f4257100 x1871272569027072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584856.604261:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784584856.604264:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1784584856.604266:0:36:0:(import.c:65:import_set_state_nolock()) ffff97c7fcece800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584856.604270:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 346 00000100:00080000:0.0:1784584856.604273:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1784584856.604288:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97c7fcece800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1784584856.604299:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1871272569027072:0@lo:38:kworker.0 00000400:00000100:0.0:1784584856.604326:0:3319:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871272569027072 offset 0 length 520: 4 00000100:00100000:0.0:1784584856.604362:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f4255180 x1871272569027200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584856.604386:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1871272569027200:0@lo:38:kworker.0 00000400:00000100:0.0:1784584856.604407:0:3319:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1871272569027200 offset 0 length 520: 4 00010000:00010000:3.0:1784584856.860014:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584857.886114:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584858.908144:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784584858.944354:0:13089:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784584858.955933:0:13089:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1784584858.955978:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.955992:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.955999:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.956005:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.956074:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784584858.956081:0:13089:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784584858.956112:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584858.956124:0:13089:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c7f4257100 x1871272569027072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584871 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584858.956138:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784584858.956143:0:13089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784584858.956148:0:13089:0:(import.c:65:import_set_state_nolock()) ffff97c7ffc53000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1784584858.956152:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584858.956156:0:13089:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c7f4257100 x1871272569027072/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584871 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584858.956163:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784584858.956166:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1784584858.956244:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1871272569027072:0@lo:38:kworker.0 00010000:00010000:1.0:1784584858.957194:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.957221:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.957229:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.957235:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957405:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584858.957412:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957420:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166f600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584858.957423:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957433:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584858.957439:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584858.957444:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784584858.957447:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784584858.957449:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784584858.957485:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957501:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584858.957507:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584858.957515:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.957522:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.957528:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584858.957535:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957544:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957550:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166f600/0x787d778cc3ff0fb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fbd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584858.957553:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784584858.957569:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569027328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584858.957571:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584858.957574:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957579:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166e800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584858.957582:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957588:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584858.957594:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584858.957598:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784584858.957600:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1784584858.957611:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957617:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584858.957622:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584858.957630:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584858.957636:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166e800/0x787d778cc3ff0fc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff0fcb expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957645:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584858.957647:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584858.957649:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584858.957656:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584858.957676:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584858.957684:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569027456:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584858.957688:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784584858.957707:0:13089:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1784584858.957712:0:13089:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000100:00100000:2.0:1784584858.957726:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1784584858.957735:0:13089:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1784584858.957739:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1784584858.957743:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584858.957748:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:2.0:1784584858.957752:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:1.0:1784584858.957752:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff97c7d8a7b380) has no exports 00010000:00010000:2.0:1784584858.957755:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957761:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818a00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584858.957763:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957769:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1784584858.957773:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff97c7d8a7b380) has no exports 10000000:00010000:2.0:1784584858.957776:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584858.957781:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784584858.957783:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784584858.957784:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784584858.957807:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957823:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584858.957839:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957846:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c801818a00/0x787d778cc3ff11ed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x787d778cc3ff11f4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584858.957854:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584858.957856:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584858.957857:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584858.957862:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784584858.957871:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569027584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584858.957894:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584858.957924:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569027328 00000100:00100000:2.0:1784584858.957930:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569027328 00000100:00100000:2.0:1784584858.957957:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569027456 00000100:00100000:2.0:1784584858.957960:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569027456 00000100:00100000:2.0:1784584858.957967:0:8317:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569027584 00000100:00100000:2.0:1784584858.957969:0:8317:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569027584 00000100:00100000:2.0:1784584858.957992:0:8317:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784584858.957998:0:8317:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3321:x1871272569027328:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1784584858.958004:0:8317:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784584858 with bad export cookie 8682227103107583121 00000020:01000000:1.0:1784584858.959592:0:13089:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97c7efc18ba0 - data ffff97c7c83a6288/ffff97c7faaf7c00 00000020:01000000:1.0:1784584858.959754:0:13089:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97c7c7f0ab40 - data ffff97c7e6fea5e8/ffff97c7e0337800 00000100:00100000:0.0:1784584858.960417:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784584858.960426:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3320:x1871272569027456:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784584858.960434:0:5792:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784584858 with bad export cookie 8682227103107583121 00000100:00100000:0.0:1784584858.960515:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3320:x1871272569027456:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (2786us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784584858.960522:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784584858.960544:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784584858.960549:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3323:x1871272569027584:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1784584858.960553:0:5792:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784584858 with bad export cookie 8682227103107583121 00000100:00100000:0.0:1784584858.960584:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c47800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3323:x1871272569027584:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (2689us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784584858.960590:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1784584858.960635:0:3323:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784584858.960639:0:3323:0:(import.c:65:import_set_state_nolock()) ffff97c7c4fc0000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1784584858.960642:0:3323:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.152@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1784584858.965905:0:3320:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.152@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1784584858.974457:0:3323:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.152@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1784584858.974478:0:3323:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1784584858.974487:0:3323:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c7f4257800 x1871272569026944/t0(0) o400->MGC192.168.203.152@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784584872 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584858.974511:0:3323:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c7f1c44e00 x1871272569027328/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584874 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584858.974529:0:3323:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c7f1c47100 x1871272569027456/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584874 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584858.974538:0:3323:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c7f1c44000 x1871272569027584/t0(0) o103->MGC192.168.203.152@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784584874 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1784584858.974547:0:3323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1784584858.974550:0:3323:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1784584858.974551:0:3323:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1784584858.974640:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c4006421-7015-489e-aaaa-81e9219afdea:3322:1871272569026944:0@lo:400:kworker.0 00000100:00080000:3.0:1784584858.974863:0:3320:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97c7c4fc0000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1784584858.974879:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c4006421-7015-489e-aaaa-81e9219afdea:3320:1871272569027456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584858.975027:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c4006421-7015-489e-aaaa-81e9219afdea:3321:1871272569027328:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1784584858.975134:0:3323:0:(import.c:65:import_set_state_nolock()) ffff97c7c4fc0000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1784584858.975140:0:3323:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 142 00000100:00080000:0.0:1784584858.975148:0:3323:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff97c7c4fc0000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1784584858.975176:0:3323:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f4257100 x1871272569027712/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784584858.975207:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c4006421-7015-489e-aaaa-81e9219afdea:3319:1871272569027712:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1784584858.975249:0:3319:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871272569027712 offset 0 length 520: 4 00000100:00100000:0.0:1784584858.975290:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c4006421-7015-489e-aaaa-81e9219afdea:3323:1871272569027584:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1784584858.980597:0:8317:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1871272569027328 offset 224 length 224: 4 00000100:00100000:2.0:1784584858.980684:0:8317:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3321:x1871272569027328:12345-0@lo:103:ldlm_bl.0 Request processed in 22682us (23050us total) trans 0 rc -107/-107 00000100:00100000:2.0:1784584858.980902:0:8317:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00100000:10000000:2.0:1784584858.986985:0:13089:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1784584859.016420:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0dc5 00000020:00000080:0.0:1784584859.016429:0:13089:0:(genops.c:906:class_export_put()) final put ffff97c8010a0800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1784584859.016449:0:13089:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c7c7f3c000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1784584859.016453:0:13089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7c7f3c000 2 00000020:01000004:0.0:1784584859.016456:0:13089:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97c7c7f3c000 from lustre-OST0000 00000020:00000080:0.0:1784584859.016478:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584859.016487:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1784584859.016489:0:13089:0:(genops.c:906:class_export_put()) final put ffff97c7d03d0000/lustre-OST0000_UUID 00000020:00000080:0.0:1784584859.016503:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d03d0000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1784584859.016510:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1784584859.016565:0:13089:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1784584859.016569:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1784584859.016573:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584859.016578:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784584859.016584:0:13089:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97c7ffc57800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:1.0:1784584859.016591:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c8010a0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00080000:0.0:1784584859.016591:0:13089:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff97c7c7f899c0) has exports, disconnecting them 00000020:00080000:0.0:1784584859.016595:0:13089:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97c7ffc57800), last request at 1784584662 00000020:00000080:0.0:1784584859.016599:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0def 00000020:00080000:0.0:1784584859.016607:0:13089:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c7ffc57800): rc 0 00000020:00000080:0.0:1784584859.016612:0:13089:0:(genops.c:906:class_export_put()) final put ffff97c7ffc57800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784584859.016639:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7ffc57800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1784584859.017746:0:13089:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1784584859.017752:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584859.017756:0:13089:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1784584859.017763:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784584859.017896:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7ffc53000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784584859.017904:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584859.017909:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1784584859.017914:0:13089:0:(genops.c:906:class_export_put()) final put ffff97c7fcecc800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1784584859.017917:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7fcecc800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1784584859.017923:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1784584859.017961:0:13089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7c7f3c000 1 00000020:00000080:1.0:1784584859.017966:0:13089:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0d7f 00000020:00000080:1.0:1784584859.017970:0:13089:0:(genops.c:906:class_export_put()) final put ffff97c7c7f3f000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1784584859.017984:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1784584859.017988:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584859.017991:0:13089:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1784584859.017994:0:13089:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff97c7fbd03380) has no exports 00000020:00000080:2.0:1784584859.018034:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c7f3f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1784584859.036125:0:13089:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784584859.036140:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1784584859.036145:0:13089:0:(genops.c:906:class_export_put()) final put ffff97c7c7f3e000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1784584859.036149:0:13089:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c7f3e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1784584859.036156:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1784584859.036292:0:13089:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97c7c7f3a800 00000020:02000400:2.0:1784584859.036332:0:13089:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1784584859.931800:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584860.955843:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784584861.421064:0:13241:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784584861.438719:0:13241:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1784584861.438802:0:13241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.438831:0:13241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.438840:0:13241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.438847:0:13241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.438871:0:13241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784584861.438876:0:13241:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1784584861.439265:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584861.439273:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.439281:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584861.439285:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.439294:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584861.439301:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584861.439308:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784584861.439310:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1784584861.439313:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1784584861.439327:0:5794:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c7c4fc0000 00010000:00010000:0.0:1784584861.439338:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.439344:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf000/0x787d778cc3ff0f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x787d778cc3ff0fa1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.439357:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584861.439358:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584861.439360:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784584861.439418:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584861.439432:0:13241:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c7f4255180 x1871272569027200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584871 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584861.439452:0:13241:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784584861.439459:0:13241:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784584861.439464:0:13241:0:(import.c:65:import_set_state_nolock()) ffff97c7fcece800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1784584861.439468:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784584861.439472:0:13241:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c7f4255180 x1871272569027200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1784584871 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584861.439479:0:13241:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784584861.439482:0:13241:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:0.0:1784584861.441623:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1871272569027200:0@lo:38:kworker.0 00010000:00010000:1.0:1784584861.442688:0:13241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.442733:0:13241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.442761:0:13241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.442768:0:13241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.442796:0:13241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584861.442804:0:13241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.442812:0:13241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.442819:0:13241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.442825:0:13241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584861.442835:0:13241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1784584861.442838:0:13241:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1784584861.442861:0:13241:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784584861.442866:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1784584861.442870:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584861.442876:0:13241:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784584861.442880:0:13241:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97c7d8a78000) has no exports 00000020:00080000:1.0:1784584861.442904:0:13241:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff97c7d8a78000) has no exports 00010000:00010000:0.0:1784584861.443644:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584861.443654:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.443663:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c166ea00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584861.443667:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.443676:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584861.443684:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584861.443704:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1784584861.443708:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1784584861.443710:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1784584861.443725:0:5793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c7c4fc0000 00010000:00010000:0.0:1784584861.443729:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.443755:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166ea00/0x787d778cc3ff0fa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x787d778cc3ff0faf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.444016:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584861.444021:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.444027:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bea00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584861.444030:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.444037:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584861.444043:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584861.444048:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1784584861.444050:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1784584861.444052:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1784584861.444058:0:5793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c7c4fc0000 00010000:00010000:0.0:1784584861.444061:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.444077:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7f42bea00/0x787d778cc3ff11df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x787d778cc3ff11e6 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584861.444091:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584861.444093:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584861.444101:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584861.444110:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784584861.451010:0:13241:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97c7efc18900 - data ffff97c7c8027948/ffff97c7faaf6800 00000020:01000000:1.0:1784584861.451157:0:13241:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff97c7fbe6c480 - data ffff97c7ffe83af8/ffff97c7ff95d400 00100000:10000000:1.0:1784584861.488366:0:13241:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784584861.511977:0:13241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0e90 00000020:00000080:3.0:1784584861.511989:0:13241:0:(genops.c:906:class_export_put()) final put ffff97c7c5ee6000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1784584861.512043:0:13241:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c7fceca000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1784584861.512047:0:13241:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7fceca000 2 00000020:01000004:3.0:1784584861.512050:0:13241:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97c7fceca000 from lustre-OST0001 00000020:00000080:3.0:1784584861.512089:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584861.512099:0:13241:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1784584861.512102:0:13241:0:(genops.c:906:class_export_put()) final put ffff97c7c5ee6800/lustre-OST0001_UUID 00000020:00000080:3.0:1784584861.512105:0:13241:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c5ee6800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1784584861.512119:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1784584861.512216:0:13241:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c4006421-7015-489e-aaaa-81e9219afdea->MGS 00010000:00010000:3.0:1784584861.512231:0:13241:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0da9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584861.512242:0:13241:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0da9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584861.512249:0:13241:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1784584861.512251:0:13241:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1784584861.512254:0:13241:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1784584861.512267:0:13241:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c7c4fc0000 00010000:00010000:3.0:1784584861.512272:0:13241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c166fc00/0x787d778cc3ff0da2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x787d778cc3ff0da9 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584861.512287:0:13241:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x787d778cc3ff0ff5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584861.512293:0:13241:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x787d778cc3ff0ff5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584861.512298:0:13241:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784584861.512300:0:13241:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1784584861.512301:0:13241:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1784584861.512310:0:13241:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97c7c4fc0000 00010000:00010000:3.0:1784584861.512312:0:13241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7faaedc00/0x787d778cc3ff0fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x787d778cc3ff0ff5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1784584861.512328:0:13241:0:(import.c:65:import_set_state_nolock()) ffff97c7c4fc0000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1784584861.512331:0:13241:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1784584861.512334:0:13241:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1784584861.512342:0:13241:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1784584861.512347:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1784584861.512357:0:13241:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff97c7f4257100 x1871272569027712/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784584868 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1784584861.512371:0:13241:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784584861.512374:0:13241:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:0.0:1784584861.514523:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c5ee6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1784584861.514829:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c4006421-7015-489e-aaaa-81e9219afdea:3319:1871272569027712:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:3.0:1784584861.515011:0:13241:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784584861.515024:0:13241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0c83 00000020:00000080:3.0:1784584861.515032:0:13241:0:(genops.c:906:class_export_put()) final put ffff97c7c4fc7800/c4006421-7015-489e-aaaa-81e9219afdea 00000020:01000000:3.0:1784584861.515045:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.152@tcp (flags='') 00000020:00000080:3.0:1784584861.515051:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584861.515059:0:13241:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.152@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1784584861.515063:0:13241:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff97c7c5d4b380) has no exports 10000000:01000000:3.0:1784584861.515098:0:5803:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1784584861.515164:0:13241:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.152@tcp: client import never connected 00000100:00080000:3.0:1784584861.515168:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1784584861.515171:0:13241:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1784584861.515174:0:13241:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1784584861.515176:0:13241:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1784584861.515210:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784584861.515216:0:13241:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.152@tcp (uuid c4006421-7015-489e-aaaa-81e9219afdea) 00000020:01000000:3.0:1784584861.515221:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1784584861.515224:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784584861.515228:0:13241:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784584861.515232:0:13241:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff97c7faade000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784584861.515237:0:13241:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff97c7fbd019c0) has exports, disconnecting them 00000020:00080000:3.0:1784584861.515241:0:13241:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff97c7faade000), last request at 1784584677 00000020:00000080:3.0:1784584861.515245:0:13241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0eba 00000020:00080000:3.0:1784584861.515255:0:13241:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff97c7faade000): rc 0 00000020:00000080:3.0:1784584861.515258:0:13241:0:(genops.c:906:class_export_put()) final put ffff97c7faade000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1784584861.516277:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c4fc7800/c4006421-7015-489e-aaaa-81e9219afdea for MGC192.168.203.152@tcp 00000020:00000080:0.0:1784584861.516292:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7faade000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1784584861.516298:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7c4fc0000 for MGC192.168.203.152@tcp 00000020:00000080:0.0:1784584861.516305:0:37:0:(genops.c:906:class_export_put()) final put ffff97c7c4fc5800/c4006421-7015-489e-aaaa-81e9219afdea 00000020:00000080:0.0:1784584861.516307:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c4fc5800/c4006421-7015-489e-aaaa-81e9219afdea for MGC192.168.203.152@tcp 00000020:01000000:0.0:1784584861.516311:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.152@tcp (c4006421-7015-489e-aaaa-81e9219afdea) 00010000:01000000:0.0:1784584861.517021:0:13241:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1784584861.517026:0:13241:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784584861.517030:0:13241:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784584861.517037:0:13241:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784584861.517056:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff97c7fcece800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1784584861.517112:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1784584861.517201:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:0.0:1784584861.531814:0:5788:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff97c7c41ac800:5788] 0 exiting: rc = 1 00000100:00100000:3.0:1784584861.532910:0:5789:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff97c7e02b6400:5789] 1 exiting: rc = 0 00000100:00100000:0.0:1784584861.540168:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.540648:0:5792:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff97c7d0770a00:5792] 2 exiting: rc = 0 00000100:00100000:0.0:1784584861.540754:0:5791:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97c7d0770e00:5791] 1 exiting: rc = 0 00000100:00100000:1.0:1784584861.545903:0:8317:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff97c7f4010a00:8317] 3 exiting: rc = 0 00000100:00100000:3.0:1784584861.558253:0:5790:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97c7d0770400:5790] 0 exiting: rc = 1 00000100:00100000:0.0:1784584861.559334:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559346:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559353:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559359:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559364:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559370:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559376:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559383:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559399:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559405:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559410:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559417:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559423:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559430:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559437:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559443:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559450:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559456:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559461:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559466:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559470:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559475:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559480:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559486:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559491:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559497:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559503:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559508:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559514:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559519:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559524:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559530:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559535:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559540:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.559545:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560290:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560305:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560311:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560316:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560320:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560325:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560330:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560334:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560350:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560356:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560361:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560366:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560371:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560376:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560381:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560387:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560392:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560397:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560402:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560407:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560412:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560417:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560423:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560428:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560433:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560438:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560442:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560447:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.560452:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784584861.565678:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784584861.565708:0:13241:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1784584861.565714:0:13241:0:(genops.c:906:class_export_put()) final put ffff97c7efc08800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1784584861.565719:0:13241:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7efc08800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1784584861.565732:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1784584861.565784:0:13241:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7fceca000 1 00000020:00000080:0.0:1784584861.565792:0:13241:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x787d778cc3ff0e5f 00000020:00000080:0.0:1784584861.565798:0:13241:0:(genops.c:906:class_export_put()) final put ffff97c7d03d6000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1784584861.565813:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1784584861.565817:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784584861.565822:0:13241:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784584861.565825:0:13241:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff97c7c7f8cd40) has no exports 00000020:00000080:0.0:1784584861.565866:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7d03d6000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1784584861.618501:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584861.618517:0:13241:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1784584861.618523:0:13241:0:(genops.c:906:class_export_put()) final put ffff97c7c7f38000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1784584861.618528:0:13241:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c7f38000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1784584861.618535:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1784584861.618751:0:13241:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97c7f3d4f000 00000020:01000000:1.0:1784584861.618772:0:13241:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1784584861.618776:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784584861.618780:0:13241:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784584861.618784:0:13241:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff97c7fbd00000) has no exports 00000020:00000080:1.0:1784584861.618806:0:13241:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784584861.618812:0:13241:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1784584861.618815:0:13241:0:(genops.c:906:class_export_put()) final put ffff97c7c7f3c800/OSS_uuid 00000020:00000080:1.0:1784584861.618817:0:13241:0:(genops.c:865:class_export_destroy()) destroying export ffff97c7c7f3c800/OSS_uuid for OSS 00000020:01000000:1.0:1784584861.618823:0:13241:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1784584861.618872:0:5802:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1784584861.618970:0:12440:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff97c7ff76ec00:12440] 4 exiting: rc = 0 00000100:00100000:3.0:1784584861.619064:0:6607:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff97c7c653de00:6607] 1 exiting: rc = 0 00000100:00100000:1.0:1784584861.620106:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff97c7f3f79400:6608] 2 exiting: rc = 0 00000100:00100000:2.0:1784584861.621729:0:6605:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff97c7c4139200:6605] 0 exiting: rc = 1 00000100:00100000:2.0:1784584861.621809:0:8782:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff97c7c41df400:8782] 3 exiting: rc = 0 00000100:00100000:3.0:1784584861.621888:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621897:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621903:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621909:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621914:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621919:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621924:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621930:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621935:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621940:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621946:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621953:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621959:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621965:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621979:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621989:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.621996:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622003:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622011:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622021:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622031:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622038:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622046:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622056:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622062:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622077:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622084:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622089:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622095:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622103:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622111:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622118:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622126:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622142:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622150:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622158:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622164:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622172:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622179:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622184:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622189:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622200:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622205:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622209:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622214:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622218:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622223:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622232:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622240:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622244:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622249:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622253:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622259:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622263:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622269:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622274:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622281:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622288:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622295:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622302:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622308:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622315:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622324:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.622332:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784584861.623639:0:6610:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff97c7e0344a00:6610] 1 exiting: rc = 0 00000100:00100000:1.0:1784584861.624771:0:6609:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff97c7e0344e00:6609] 0 exiting: rc = 1 00000100:00100000:3.0:1784584861.624845:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624855:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624865:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624873:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624893:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624899:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624904:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624910:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624916:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624922:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624927:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624932:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624938:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624944:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624986:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.624996:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625005:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625014:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625024:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625033:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625043:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625052:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625063:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625087:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625098:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625108:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625117:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625126:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625135:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625143:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625152:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625161:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625171:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625180:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625190:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625197:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625202:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625208:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625213:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625227:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625233:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625238:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625244:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625249:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625255:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625260:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625265:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625270:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625275:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625280:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625285:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625292:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625298:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625303:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625308:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625314:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625319:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625325:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625330:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625336:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625341:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625347:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625352:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.625358:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784584861.627846:0:6611:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff97c7e0344000:6611] 0 exiting: rc = 1 00000100:00100000:1.0:1784584861.627975:0:6613:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff97c7e0344200:6613] 2 exiting: rc = 0 00000100:00100000:0.0:1784584861.628491:0:6612:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97c7e0345800:6612] 1 exiting: rc = 0 00000100:00100000:3.0:1784584861.629007:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629035:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629042:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629047:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629055:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629063:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629080:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629089:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629097:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629105:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629128:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629136:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629142:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629148:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629154:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629160:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629168:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629175:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629199:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629207:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629219:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629227:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629235:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629244:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629250:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629257:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629265:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629272:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629279:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629286:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629296:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629306:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629315:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629323:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629331:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629337:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629343:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629353:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629359:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629368:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629375:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629382:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629411:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629420:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629431:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629448:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629455:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629463:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629470:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629476:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629483:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629490:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629496:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629503:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629511:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629518:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629524:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629531:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629539:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629547:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629556:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629567:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629580:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784584861.629590:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.637434:0:6615:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97c7e0344c00:6615] 1 exiting: rc = 0 00000100:00100000:2.0:1784584861.639376:0:6614:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff97c7e0345000:6614] 0 exiting: rc = 1 00000100:00100000:0.0:1784584861.639664:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639671:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639677:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639682:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639688:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639711:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639717:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639724:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639728:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639733:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639737:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639742:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639747:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639752:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639757:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639763:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639768:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639773:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639777:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639782:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639787:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639792:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639796:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639802:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639807:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639813:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639818:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639823:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639827:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639832:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639837:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639842:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639858:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639863:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639867:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639872:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639885:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639890:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639895:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639901:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639906:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639911:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639916:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639921:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639926:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639932:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639937:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639942:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639947:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639951:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639956:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639961:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639965:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639969:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639974:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639979:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639984:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.639989:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.640002:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.640008:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.640013:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.640018:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.640023:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.640028:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.641973:0:6617:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff97c7d8700800:6617] 1 exiting: rc = 0 00000100:00100000:1.0:1784584861.643327:0:6616:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97c7e0345c00:6616] 0 exiting: rc = 1 00000100:00100000:0.0:1784584861.646395:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646407:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646424:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646430:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646435:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646440:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646445:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646451:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646458:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646464:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646469:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646475:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646493:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646500:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646505:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646511:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646516:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646523:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646528:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646534:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646554:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646561:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646567:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646574:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646951:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646962:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646968:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646974:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646980:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646986:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.646992:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647240:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647249:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647255:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647260:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647266:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647290:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647306:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647312:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647318:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647324:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647330:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647336:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647342:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647349:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647354:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647359:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647364:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647384:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647391:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647396:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647422:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647431:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647437:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647443:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647448:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647455:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647461:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647467:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647473:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647495:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647503:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647509:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784584861.647515:0:13241:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1784584861.666320:0:13241:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1784584876.299511:0:13870:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1784584883.250214:0:14283:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1784584883.250219:0:14283:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1784584883.250354:0:14283:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97c7f428a800 00000020:01000004:0.0:1784584883.250368:0:14283:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1784584883.250375:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1784584883.250389:0:14283:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97c801b219c0) 00000020:00000080:0.0:1784584883.250402:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1784584883.266265:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1784584883.268246:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1784584883.268562:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 405: rc = 0 00100000:10000000:1.0:1784584883.268765:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1784584883.268834:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 405: rc = 0 00100000:10000000:1.0:1784584883.268923:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 405: rc = 0 00100000:10000000:1.0:1784584883.269023:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 405: rc = 0 00100000:10000000:1.0:1784584883.269113:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 405: rc = 0 00100000:10000000:1.0:1784584883.269516:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 405: rc = 0 00100000:10000000:1.0:1784584883.269796:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 407: rc = 0 00100000:10000000:1.0:1784584883.270867:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 493: rc = 0 00100000:10000000:1.0:1784584883.270974:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 493: rc = 0 00100000:10000000:1.0:1784584883.271390:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 188: rc = 0 00100000:10000000:1.0:1784584883.271618:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 188: rc = 0 00100000:10000000:1.0:1784584883.271996:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 188: rc = 0 00100000:10000000:1.0:1784584883.272224:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 188: rc = 0 00100000:10000000:1.0:1784584883.272455:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 188: rc = 0 00100000:10000000:1.0:1784584883.272882:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 188: rc = 0 00100000:10000000:1.0:1784584883.273135:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 188: rc = 0 00100000:10000000:1.0:1784584883.273376:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 188: rc = 0 00100000:10000000:1.0:1784584883.273604:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 188: rc = 0 00100000:10000000:1.0:1784584883.273873:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 188: rc = 0 00100000:10000000:1.0:1784584883.274127:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 188: rc = 0 00100000:10000000:1.0:1784584883.274357:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 188: rc = 0 00100000:10000000:1.0:1784584883.274767:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 509: rc = 0 00100000:10000000:1.0:1784584883.275029:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 509: rc = 0 00100000:10000000:1.0:1784584883.275256:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 509: rc = 0 00100000:10000000:1.0:1784584883.275509:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 509: rc = 0 00100000:10000000:1.0:1784584883.275782:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 509: rc = 0 00100000:10000000:1.0:1784584883.276084:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 509: rc = 0 00100000:10000000:1.0:1784584883.276315:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 509: rc = 0 00100000:10000000:1.0:1784584883.276545:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 509: rc = 0 00100000:10000000:1.0:1784584883.277014:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 509: rc = 0 00100000:10000000:1.0:1784584883.277273:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 509: rc = 0 00100000:10000000:1.0:1784584883.277519:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 509: rc = 0 00100000:10000000:1.0:1784584883.277814:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 509: rc = 0 00100000:10000000:1.0:1784584883.278066:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 509: rc = 0 00100000:10000000:1.0:1784584883.278324:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 509: rc = 0 00100000:10000000:1.0:1784584883.278555:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 509: rc = 0 00100000:10000000:1.0:1784584883.278816:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 509: rc = 0 00100000:10000000:1.0:1784584883.279059:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 509: rc = 0 00100000:10000000:1.0:1784584883.279297:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 509: rc = 0 00100000:10000000:1.0:1784584883.279535:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 509: rc = 0 00100000:10000000:1.0:1784584883.280601:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 509: rc = 0 00100000:10000000:1.0:1784584883.280976:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 509: rc = 0 00100000:10000000:1.0:1784584883.281231:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 509: rc = 0 00100000:10000000:1.0:1784584883.281472:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 509: rc = 0 00100000:10000000:1.0:1784584883.281770:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 509: rc = 0 00100000:10000000:1.0:1784584883.282024:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 509: rc = 0 00100000:10000000:1.0:1784584883.282292:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 509: rc = 0 00100000:10000000:1.0:1784584883.282540:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 509: rc = 0 00100000:10000000:1.0:1784584883.282811:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 509: rc = 0 00100000:10000000:1.0:1784584883.283054:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 509: rc = 0 00100000:10000000:1.0:1784584883.283290:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 509: rc = 0 00100000:10000000:1.0:1784584883.283518:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 509: rc = 0 00100000:10000000:1.0:1784584883.283780:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 509: rc = 0 00100000:10000000:1.0:1784584883.284512:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 629: rc = 0 00100000:10000000:1.0:1784584883.285242:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:1.0:1784584883.285417:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 76: rc = 0 00100000:10000000:1.0:1784584883.285620:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:1.0:1784584883.285688:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 76: rc = 0 00100000:10000000:1.0:1784584883.285906:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:1.0:1784584883.285993:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 76: rc = 0 00100000:10000000:1.0:1784584883.286368:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:1.0:1784584883.286440:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 625: rc = 0 00100000:10000000:1.0:1784584883.286630:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:1.0:1784584883.286723:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 625: rc = 0 00100000:10000000:1.0:1784584883.287118:0:14283:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:1.0:1784584883.287192:0:14283:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 625: rc = 0 00000020:00000080:1.0:1784584883.287444:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784584883.287452:0:14283:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784584883.287463:0:14283:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff1f84 00000020:01000004:1.0:1784584883.287471:0:14283:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1784584883.287476:0:14283:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784584883.287481:0:14283:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c7f428a800 from MGS 00000020:01000004:1.0:1784584883.287484:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784584883.287494:0:14283:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97c7d8a78000) 00000020:00000080:1.0:1784584883.287504:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1784584883.287555:0:14283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c7f428a800 from MGS, refs=2 00080000:01000000:1.0:1784584883.287559:0:14283:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784584883.287564:0:14283:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff1f92 00000100:00100000:1.0:1784584883.287649:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1784584883.287854:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1784584883.287861:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1784584883.288265:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1784584883.288271:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1784584883.288942:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584883.289069:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1784584883.289074:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1784584883.289497:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1784584883.289508:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1784584883.289904:0:14283:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1784584883.289909:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1784584883.290451:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584883.290454:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584883.290456:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584883.290735:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584883.290737:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584883.290739:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584883.291247:0:14283:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1784584883.296177:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1784584883.304961:0:14283:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1784584883.304980:0:14283:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1784584883.304982:0:14283:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1784584883.306541:0:14292:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784584883.307304:0:14283:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784584883.307405:0:14283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784584883.308527:0:14283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784584883.312973:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584883.313142:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784584883.313149:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1784584883.315195:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1784584883.315207:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784584883.320890:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784584883.320908:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1784584883.323473:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1784584883.323498:0:14283:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.152@tcp' 00000020:01000004:3.0:1784584883.323500:0:14283:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1784584883.323527:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.152@tcp (typ=mgc) 00000020:00000080:3.0:1784584883.323540:0:14283:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.152@tcp (ffff97c7c7f8b380) 00000020:00000080:3.0:1784584883.323558:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1784584883.323737:0:14297:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:3.0:1784584883.323795:0:14283:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7c4146000@MGC192.168.203.152@tcp: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1784584883.323963:0:14283:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.152@tcp-0 is initialized 00000040:01000000:3.0:1784584883.323969:0:14283:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 1 is initialized 10000000:01000000:3.0:1784584883.330099:0:14298:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784584883.330183:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.152@tcp (uuid 978ed13c-6d08-4d66-8bb5-98db460a5248) 00000020:00000080:1.0:1784584883.330206:0:14283:0:(genops.c:1406:class_connect()) connect: client 978ed13c-6d08-4d66-8bb5-98db460a5248, cookie 0x787d778cc3ff1fa0 00000100:00080000:1.0:1784584883.330218:0:14283:0:(import.c:510:import_select_connection()) MGC192.168.203.152@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784584883.330223:0:14283:0:(import.c:624:import_select_connection()) MGC192.168.203.152@tcp: import ffff97c7c4146000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1784584883.330253:0:14283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8010bea00 x1871272569027840/t0(0) o250->MGC192.168.203.152@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584883.330271:0:14283:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 978ed13c-6d08-4d66-8bb5-98db460a5248->MGS 00000020:01000004:1.0:1784584883.330301:0:14283:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784584883.330306:0:14283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784584883.330318:0:14283:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff97c7d8a7b380) 00000020:00000080:1.0:1784584883.330330:0:14283:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784584883.331110:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:978ed13c-6d08-4d66-8bb5-98db460a5248:3319:1871272569027840:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784584883.331199:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584883.331301:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569027840 00000100:00100000:0.0:1784584883.331308:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569027840 00000100:00100000:0.0:1784584883.331344:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584883.331351:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d84f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3319:x1871272569027840:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1784584883.331374:0:14293:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 978ed13c-6d08-4d66-8bb5-98db460a5248@0@lo t0 exp 0000000000000000 cur 378 last 0 00000020:00000080:0.0:1784584883.331396:0:14293:0:(genops.c:1406:class_connect()) connect: client 978ed13c-6d08-4d66-8bb5-98db460a5248, cookie 0x787d778cc3ff1fae 00000100:00080000:0.0:1784584883.331517:0:14293:0:(import.c:65:import_set_state_nolock()) ffff97c7f428f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584883.331566:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d84f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+5:3319:x1871272569027840:12345-0@lo:250:mount.lustre.0 Request processed in 214us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584883.331574:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784584883.332070:0:3319:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.152@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784584883.332079:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.152@tcp: connect to target with instance 0 00000100:00080000:0.0:1784584883.332088:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.152@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784584883.332093:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784584883.332097:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7c4146000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784584883.332099:0:3319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784584883.332113:0:3319:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784584883.332118:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:978ed13c-6d08-4d66-8bb5-98db460a5248:3319:1871272569027840:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1784584883.349335:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584883.349524:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1784584883.349530:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1784584883.353282:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1784584883.353294:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1784584883.353623:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1784584883.353629:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1784584883.354593:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584883.355852:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1784584883.355861:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1784584883.356474:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1784584883.356481:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1784584883.404957:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784584883.405161:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1784584883.405168:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784584883.406477:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784584883.406487:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1784584883.407047:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584883.407189:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784584883.407194:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1784584883.407601:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784584883.407608:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1784584883.408134:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584883.408265:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784584883.408270:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1784584883.408664:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1784584883.408676:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1784584883.409238:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584883.409374:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784584883.409380:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1784584883.410052:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784584883.410059:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784584883.423970:0:14283:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584883.424413:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784584883.424419:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1784584883.428805:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784584883.428837:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1784584883.443615:0:14283:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784584883.443631:0:14283:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1784584883.444774:0:14283:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1784584883.444797:0:14283:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1784584883.444803:0:14283:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1784584883.444922:0:14283:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784584883.444968:0:14283:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1784584883.444973:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784584883.444974:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784584883.444975:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584883.444977:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584883.444978:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584883.444979:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584883.444980:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784584883.444982:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784584883.444983:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584883.444985:0:14283:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584883.444987:0:14283:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1784584883.444990:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784584883.444991:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784584883.444992:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584883.444993:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584883.444994:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584883.444995:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584883.444996:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784584883.444997:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784584883.444998:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584883.444999:0:14283:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784584883.445024:0:14283:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1784584883.445043:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569027968:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784584883.445113:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.445156:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020d480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584883.445234:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569027968 00000100:00100000:3.0:1784584883.445241:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569027968 00000100:00100000:3.0:1784584883.445282:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584883.445291:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d84f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+5:14283:x1871272569027968:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784584883.445328:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784584883.445332:0:14296:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1784584883.445334:0:14296:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1784584883.446164:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1784584883.446511:0:14296:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1784584883.448513:0:14318:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1784584883.448519:0:14318:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1784584883.448523:0:14318:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1784584883.448552:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1784584883.449095:0:14296:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784584883.449105:0:14296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1784584883.465578:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d84f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+5:14283:x1871272569027968:12345-0@lo:253:mount.lustre.0 Request processed in 20279us (20456us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584883.465592:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784584883.465815:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569027968:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784584883.465845:0:14283:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1784584883.465848:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784584883.465850:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1784584883.465851:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784584883.465852:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784584883.465854:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784584883.465855:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784584883.465856:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1784584883.465857:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1784584883.465859:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784584883.465860:0:14283:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784584883.465879:0:14283:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c7f428a800 from lustre-MDT0000 10000000:01000000:1.0:1784584883.465902:0:14283:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1784584883.465905:0:14283:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784584883.465910:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97c7c7f8b380 10000000:01000000:1.0:1784584883.465914:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584883.465921:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff97c7c7f8b380 from 1 10000000:01000000:1.0:1784584883.465934:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784584883.465973:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.465984:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.465993:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.466012:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028096:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584883.466050:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.466081:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020d480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584883.466308:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569028096 00000100:00100000:3.0:1784584883.466314:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569028096 00000100:00100000:3.0:1784584883.466354:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584883.466363:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+5:14283:x1871272569028096:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584883.466375:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584883.466389:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaeda00/0x787d778cc3ff1fbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff1fb5 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.466410:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaeda00/0x787d778cc3ff1fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff1fb5 expref: 6 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.466420:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaeda00/0x787d778cc3ff1fbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1fb5 expref: 6 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.466436:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaeda00, rc 0) 00000100:00100000:3.0:1784584883.466473:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+6:14283:x1871272569028096:12345-0@lo:101:mount.lustre.0 Request processed in 112us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584883.466479:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784584883.466589:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028096:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584883.466602:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.466628:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.466675:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028224:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584883.466768:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.466793:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020d480 going to sleep for 11 seconds 00000100:00100000:3.0:1784584883.466957:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569028224 00000100:00100000:3.0:1784584883.466961:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569028224 00000100:00100000:3.0:1784584883.466995:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584883.467001:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+6:14283:x1871272569028224:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584883.467233:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+6:14283:x1871272569028224:12345-0@lo:501:mount.lustre.0 Request processed in 231us (462us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784584883.467240:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784584883.467317:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028224:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784584883.467343:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784584883.467361:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467369:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584883.467377:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c7f428a800 10000000:01000000:1.0:1784584883.467381:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784584883.467386:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97c7f428a800 10000000:01000000:1.0:1784584883.467388:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1784584883.467391:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff97c7f428a800 from 1 10000000:01000000:1.0:1784584883.467394:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1784584883.467413:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801819200/0x787d778cc3ff1fc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467420:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801819200/0x787d778cc3ff1fc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467429:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801819200/0x787d778cc3ff1fc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.467449:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028352:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584883.467473:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.467494:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020d480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584883.467522:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569028352 00000100:00100000:1.0:1784584883.467527:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569028352 00000100:00100000:1.0:1784584883.467552:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584883.467558:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+6:14283:x1871272569028352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584883.467565:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584883.467577:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801819600/0x787d778cc3ff1fca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff1fc3 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467593:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801819600/0x787d778cc3ff1fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff1fc3 expref: 7 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467603:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801819600/0x787d778cc3ff1fca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1fc3 expref: 7 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467722:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819600, rc 0) 00000100:00100000:1.0:1784584883.467751:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+7:14283:x1871272569028352:12345-0@lo:101:mount.lustre.0 Request processed in 193us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584883.467757:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584883.467790:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028352:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584883.467802:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801819200/0x787d778cc3ff1fc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fca expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467810:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801819200/0x787d778cc3ff1fc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff1fca expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584883.467828:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1784584883.467832:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801819200/0x787d778cc3ff1fc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fca expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467838:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801819200/0x787d778cc3ff1fc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fca expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584883.467844:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1784584883.467847:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584883.467851:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97c7f428a800 10000000:01000000:1.0:1784584883.467854:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1784584883.467857:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1784584883.467859:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784584883.467873:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818200/0x787d778cc3ff1fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467879:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801818200/0x787d778cc3ff1fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.467887:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801818200/0x787d778cc3ff1fd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.467898:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028480:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584883.467922:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.467952:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569028480 00000100:00100000:1.0:1784584883.467956:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569028480 00000100:00100000:1.0:1784584883.467976:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584883.467981:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+7:14283:x1871272569028480:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584883.467996:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584883.468004:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801818600/0x787d778cc3ff1fd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff1fd1 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.468019:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801818600/0x787d778cc3ff1fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff1fd1 expref: 8 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.468028:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801818600/0x787d778cc3ff1fd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff1fd1 expref: 8 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.468034:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818600, rc 0) 00000100:00100000:1.0:1784584883.468056:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+8:14283:x1871272569028480:12345-0@lo:101:mount.lustre.0 Request processed in 75us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584883.468063:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584883.468091:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d020d480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584883.468102:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584883.468112:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801818200/0x787d778cc3ff1fd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fd8 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.468120:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801818200/0x787d778cc3ff1fd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff1fd8 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.468158:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584883.468179:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.468196:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569028608 00000100:00100000:1.0:1784584883.468199:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569028608 00000100:00100000:1.0:1784584883.468218:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584883.468224:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+8:14283:x1871272569028608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584883.468538:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+9:14283:x1871272569028608:12345-0@lo:501:mount.lustre.0 Request processed in 314us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584883.468546:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584883.468570:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d07229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584883.468582:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584883.468607:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028736:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584883.472157:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.472208:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d07229c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584883.472425:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569028736 00000100:00100000:2.0:1784584883.472433:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569028736 00000100:00100000:2.0:1784584883.472484:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584883.472493:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+9:14283:x1871272569028736:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584883.472896:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+9:14283:x1871272569028736:12345-0@lo:503:mount.lustre.0 Request processed in 404us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584883.472904:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584883.473171:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569028736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584883.473885:0:14319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14319:1871272569028864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584883.473953:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584883.473990:0:14319:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b900 going to sleep for 11 seconds 00000100:00100000:3.0:1784584883.474036:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569028864 00000100:00100000:3.0:1784584883.474041:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569028864 00000100:00100000:3.0:1784584883.474076:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584883.474084:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+9:14319:x1871272569028864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584883.474344:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+9:14319:x1871272569028864:12345-0@lo:502:llog_process_th.0 Request processed in 260us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584883.474353:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584883.474448:0:14319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14319:1871272569028864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784584883.474474:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584883.474485:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.474487:0:14319:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784584883.474493:0:14319:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784584883.474496:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584883.474511:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97c801b24d40) 00000020:00000080:0.0:1784584883.474527:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784584883.474532:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784584883.474604:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784584883.474772:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff1fe6 00000020:00000080:0.0:1784584883.475109:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784584883.475120:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584883.475123:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.475125:0:14319:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784584883.475128:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584883.475131:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.475132:0:14319:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784584883.475135:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584883.475143:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97c801b23380) 00000020:00000080:0.0:1784584883.475152:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784584883.475156:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784584883.475158:0:14319:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784584883.475160:0:14319:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784584883.475166:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784584883.475205:0:14319:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c7f428a800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784584883.475216:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97c801b20000) 00000020:00000080:0.0:1784584883.475222:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784584883.475261:0:14319:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784584883.475266:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff1ffb 00000020:00000080:0.0:1784584883.475346:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784584883.475351:0:14319:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784584883.475355:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x787d778cc3ff2002 00080000:01000000:0.0:1784584883.475360:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784584883.475363:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff2009 00010000:00010000:2.0:1784584883.606021:0:14319:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1784584883.607022:0:14319:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1784584883.607493:0:14319:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1784584883.609265:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97c7c7f8cd40) 00000020:00000080:3.0:1784584883.609355:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1784584883.609423:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1784584883.609431:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff2017 00000020:00000080:1.0:1784584883.611480:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1784584883.632760:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x787d778cc3ff201e 00000020:00000080:1.0:1784584883.632945:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1784584883.632958:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584883.632963:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584883.632965:0:14319:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1784584883.632968:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584883.632973:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584883.632975:0:14319:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1784584883.632980:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1784584883.633011:0:14319:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1784584883.633021:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584883.633023:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584883.633025:0:14319:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1784584883.633027:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784584883.633028:0:14319:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1784584883.633030:0:14319:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784584883.633031:0:14319:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784584883.633033:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784584883.633035:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584883.633036:0:14319:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784584883.633046:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784584883.633049:0:14319:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784584883.633052:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584883.633053:0:14319:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784584883.633056:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784584883.633062:0:14319:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:1.0:1784584883.633389:0:14319:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784584883.633393:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784584883.633407:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97c7d8a799c0) 00000020:00000080:1.0:1784584883.633421:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1784584883.633426:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784584883.633489:0:14319:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784584883.633494:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784584883.633500:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff202c 00010000:00080000:1.0:1784584883.633528:0:14319:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7c70b2000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1784584883.633886:0:14319:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1784584883.636451:0:14319:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784584883.636525:0:14319:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784584883.639373:0:14319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784584883.639462:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1784584883.639526:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1784584883.643183:0:14323:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1784584883.643195:0:14323:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1784584883.645477:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584883.645493:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784584883.645528:0:14319:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1784584883.645549:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff2033 00000100:00080000:0.0:1784584883.645558:0:14319:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584883.645564:0:14319:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97c7c70b2000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1784584883.645892:0:14319:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f4257100 x1871272569028992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584883.645975:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569028992:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784584883.646030:0:3319:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871272569028992 offset 0 length 520: 4 00000100:00080000:0.0:1784584883.646203:0:14319:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1784584883.646373:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584883.646378:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.646380:0:14319:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1784584883.646383:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784584883.646386:0:14319:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1784584883.646387:0:14319:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584883.646389:0:14319:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784584883.646390:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784584883.646392:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.646393:0:14319:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784584883.646396:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784584883.646400:0:14319:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784584883.646404:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.646405:0:14319:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784584883.646408:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784584883.646412:0:14319:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.152@tcp to nid 0x20000c0a8cb98 (192.168.203.152@tcp) 00000020:01000000:0.0:1784584883.646433:0:14319:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784584883.646435:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584883.646448:0:14319:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97c7c5d4b380) 00000020:00000080:0.0:1784584883.646462:0:14319:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1784584883.646466:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784584883.646518:0:14319:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784584883.646524:0:14319:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784584883.646533:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x787d778cc3ff2041 00010000:00080000:0.0:1784584883.646559:0:14319:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7d0348000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:0.0:1784584883.646858:0:14319:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1784584883.647049:0:14319:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784584883.647417:0:14319:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784584883.648518:0:14319:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584883.648586:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1784584883.649020:0:14319:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1784584883.649665:0:14325:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784584883.649670:0:14325:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784584883.651003:0:14319:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784584883.651019:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784584883.651064:0:14319:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784584883.651157:0:14319:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff2048 00000100:00080000:0.0:1784584883.651171:0:14319:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1784584883.651177:0:14319:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c7d0348000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:0.0:1784584883.651215:0:14319:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f4255180 x1871272569029120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784584883.651343:0:14319:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784584883.651431:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584883.651436:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.651438:0:14319:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784584883.651440:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584883.651444:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.651445:0:14319:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784584883.651448:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784584883.651449:0:14319:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784584883.651451:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584883.651453:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.651454:0:14319:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784584883.651456:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584883.651457:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.651458:0:14319:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784584883.651462:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784584883.651493:0:14319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4255c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14319:1871272569029248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584883.651565:0:14319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584883.651619:0:14319:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcf63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584883.651668:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569029120:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1784584883.651716:0:3319:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871272569029120 offset 0 length 520: 4 00000100:00100000:1.0:1784584883.652196:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569029248 00000100:00100000:1.0:1784584883.652203:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569029248 00000100:00100000:1.0:1784584883.652250:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584883.652260:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+9:14319:x1871272569029248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584883.652638:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+9:14319:x1871272569029248:12345-0@lo:502:llog_process_th.0 Request processed in 378us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584883.652647:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584883.654003:0:14319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4255c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14319:1871272569029248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784584883.654046:0:14319:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584883.654053:0:14319:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584883.654055:0:14319:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784584883.654059:0:14319:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1784584883.654389:0:14283:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1784584883.654411:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784584883.654445:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818200/0x787d778cc3ff1fd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fd8 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.654457:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801818200/0x787d778cc3ff1fd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fd8 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584883.654465:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97c7f428a800 from 1 10000000:01000000:1.0:1784584883.654468:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584883.654502:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.654510:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.654520:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.654540:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584883.654590:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.655000:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584883.655096:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569029376 00000100:00100000:0.0:1784584883.655111:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569029376 00000100:00100000:0.0:1784584883.655158:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784584883.655166:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+9:14283:x1871272569029376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584883.655178:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584883.655194:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff204f expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584883.655219:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff204f expref: 10 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584883.655230:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff204f expref: 10 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584883.655239:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf200, rc 0) 00000100:00100000:1.0:1784584883.655502:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584883.655516:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.655524:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.656166:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029504:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784584883.656302:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.656380:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc989c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584883.656489:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569029504 00000100:00100000:2.0:1784584883.656495:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569029504 00000100:00100000:2.0:1784584883.656533:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784584883.656542:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+11:14283:x1871272569029504:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1784584883.656557:0:14296:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1784584883.656563:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1784584883.656628:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+11:14283:x1871272569029504:12345-0@lo:256:mount.lustre.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584883.656635:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784584883.657035:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029504:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1784584883.657636:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784584883.657658:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.657669:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584883.657677:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7f428a800 from 1 10000000:01000000:1.0:1784584883.657680:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584883.657743:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.657752:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.657760:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.657776:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584883.657821:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.657854:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc989c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584883.658156:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569029632 00000100:00100000:3.0:1784584883.658163:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569029632 00000100:00100000:3.0:1784584883.658199:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584883.658207:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+11:14283:x1871272569029632:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584883.658218:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584883.658232:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff205d expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.658253:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff205d expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.658264:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff205d expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.658284:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaedc00, rc 0) 00000100:00100000:3.0:1784584883.658325:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14283:x1871272569029632:12345-0@lo:101:mount.lustre.0 Request processed in 119us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584883.658332:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584883.658375:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584883.658389:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.658398:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584883.658447:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584883.658486:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584883.658512:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d87986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584883.658556:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569029760 00000100:00100000:2.0:1784584883.658560:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569029760 00000100:00100000:2.0:1784584883.658578:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584883.658584:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14283:x1871272569029760:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584883.659009:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14283:x1871272569029760:12345-0@lo:501:mount.lustre.0 Request processed in 424us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584883.659016:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784584883.659250:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584883.659295:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584883.659335:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584883.659363:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d87986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584883.659446:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569029888 00000100:00100000:2.0:1784584883.659451:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569029888 00000100:00100000:2.0:1784584883.659470:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784584883.659476:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14283:x1871272569029888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584883.659621:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14283:x1871272569029888:12345-0@lo:503:mount.lustre.0 Request processed in 144us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584883.659636:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784584883.659800:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569029888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584883.660317:0:14327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14327:1871272569030016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584883.660357:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584883.660383:0:14327:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93240 going to sleep for 11 seconds 00000100:00100000:3.0:1784584883.660472:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569030016 00000100:00100000:3.0:1784584883.660476:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569030016 00000100:00100000:3.0:1784584883.660504:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584883.660510:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14327:x1871272569030016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784584883.660726:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14327:x1871272569030016:12345-0@lo:502:llog_process_th.0 Request processed in 215us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584883.660733:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784584883.660947:0:14327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14327:1871272569030016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584883.660972:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584883.660981:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584883.660983:0:14327:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784584883.660992:0:14327:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7f428a800 00000020:00000080:2.0:1784584883.660994:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584883.661002:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584883.661004:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584883.661006:0:14327:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784584883.661008:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584883.661010:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584883.661012:0:14327:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784584883.661015:0:14327:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7f428a800 00000020:00000080:2.0:1784584883.661017:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784584883.661081:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584883.661085:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584883.661086:0:14327:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784584883.661088:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584883.661091:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584883.661092:0:14327:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784584883.661095:0:14327:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c7f428a800 00000020:00000080:2.0:1784584883.661097:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784584883.661132:0:14327:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14327:1871272569030144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584883.661169:0:14327:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584883.661199:0:14327:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93240 going to sleep for 11 seconds 00000100:00100000:1.0:1784584883.661256:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569030144 00000100:00100000:1.0:1784584883.661261:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569030144 00000100:00100000:1.0:1784584883.661304:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784584883.661310:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14327:x1871272569030144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784584883.661436:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14327:x1871272569030144:12345-0@lo:502:llog_process_th.0 Request processed in 126us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584883.661450:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784584883.661639:0:14327:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14327:1871272569030144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784584883.661657:0:14327:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584883.661661:0:14327:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584883.661663:0:14327:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784584883.661666:0:14327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1784584883.661907:0:14283:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1784584883.661935:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584883.661954:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.661965:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584883.662002:0:14283:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784584883.662005:0:14283:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c7f428a800 10000000:01000000:1.0:1784584883.662008:0:14283:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c7f428a800 10000000:01000000:1.0:1784584883.662012:0:14283:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784584883.662018:0:14283:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7f428a800 from 1 10000000:01000000:1.0:1784584883.662021:0:14283:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784584883.662045:0:14283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801819800/0x787d778cc3ff206b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.662053:0:14283:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801819800/0x787d778cc3ff206b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.662061:0:14283:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801819800/0x787d778cc3ff206b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.662085:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569030272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584883.662118:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.662140:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584883.662155:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569030272 00000100:00100000:1.0:1784584883.662159:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569030272 00000100:00100000:1.0:1784584883.662190:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584883.662196:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14283:x1871272569030272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584883.662206:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584883.662218:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801819c00/0x787d778cc3ff2072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff206b expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.662239:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801819c00/0x787d778cc3ff2072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff206b expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.662248:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801819c00/0x787d778cc3ff2072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff206b expref: 13 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.662256:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819c00, rc 0) 00000100:00100000:1.0:1784584883.662469:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+13:14283:x1871272569030272:12345-0@lo:101:mount.lustre.0 Request processed in 272us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584883.662476:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584883.662516:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569030272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584883.662529:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801819800/0x787d778cc3ff206b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2072 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584883.662537:0:14283:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801819800/0x787d778cc3ff206b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff2072 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584883.662577:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569030400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584883.662600:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.662743:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584883.662758:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569030400 00000100:00100000:1.0:1784584883.662761:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569030400 00000100:00100000:1.0:1784584883.662788:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784584883.662794:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+13:14283:x1871272569030400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584883.663405:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+13:14283:x1871272569030400:12345-0@lo:501:mount.lustre.0 Request processed in 609us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584883.663413:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1784584883.663457:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569030400:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584883.663489:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569030528:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584883.663526:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.663540:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc983c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784584883.663553:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569030528 00000100:00100000:1.0:1784584883.663557:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569030528 00000100:00100000:1.0:1784584883.663579:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1784584883.663585:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+13:14283:x1871272569030528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584883.666890:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+13:14283:x1871272569030528:12345-0@lo:503:mount.lustre.0 Request processed in 3297us (3356us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584883.666905:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784584883.671215:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14283:x1871272569029376:12345-0@lo:101:mount.lustre.0 Request processed in 16041us (16616us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584883.671227:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784584883.675849:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010be300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569030528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584883.699995:0:14329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4255c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14329:1871272569030656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584883.700089:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584883.700159:0:14329:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcf69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584883.703373:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569030656 00000100:00100000:2.0:1784584883.703389:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569030656 00000100:00100000:2.0:1784584883.703433:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584883.703442:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14329:x1871272569030656:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584883.703719:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14329:x1871272569030656:12345-0@lo:502:llog_process_th.0 Request processed in 277us (3630us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584883.703727:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784584883.705803:0:14329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4255c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14329:1871272569030656:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1784584883.705879:0:14329:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1784584883.705895:0:14329:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97c7d8a7cd40) 00000020:00000080:1.0:1784584883.705914:0:14329:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1784584883.706225:0:14329:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c7f428a800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784584883.706230:0:14329:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c7f428a800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1784584883.706232:0:14329:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7f428a800 4 00010000:00080000:1.0:1784584883.706260:0:14329:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7e0551000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.152@tcp at head 00010000:00010000:1.0:1784584883.711794:0:14329:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1784584883.711902:0:14329:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1784584883.711960:0:14329:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784584883.711975:0:14329:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x787d778cc3ff2080 00000100:00080000:1.0:1784584883.711985:0:14329:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784584883.711991:0:14329:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97c7e0551000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:1.0:1784584883.712026:0:14329:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c8010bd500 x1871272569030784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784584883.712050:0:14329:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784584883.712384:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272569030784:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584883.712453:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584883.714282:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569030784 00000100:00100000:1.0:1784584883.714294:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569030784 00000100:00100000:1.0:1784584883.714336:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584883.714344:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1871272569030784:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1784584883.714428:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1871272569030784:12345-0@lo:38:llog_process_th.0 Request processed in 84us (1975us total) trans 0 rc -11/-11 00000100:00100000:1.0:1784584883.714436:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584883.714478:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784584883.714486:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7e0551000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784584883.714490:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1784584883.714494:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272569030784:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1784584883.717386:0:14329:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4255500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14329:1871272569030912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784584883.717461:0:14329:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584883.717504:0:14329:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcf6540 going to sleep for 11 seconds 00000100:00100000:2.0:1784584883.717610:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569030912 00000100:00100000:2.0:1784584883.717618:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569030912 00000100:00100000:2.0:1784584883.717658:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584883.717667:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14329:x1871272569030912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784584883.717963:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14329:x1871272569030912:12345-0@lo:502:llog_process_th.0 Request processed in 296us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584883.717971:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1784584883.718136:0:14329:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4255500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:978ed13c-6d08-4d66-8bb5-98db460a5248:14329:1871272569030912:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1784584883.718164:0:14329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1784584883.718299:0:14283:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1784584883.718318:0:14283:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784584883.718331:0:14283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801819800/0x787d778cc3ff206b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2072 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584883.718354:0:14283:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801819800/0x787d778cc3ff206b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2072 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784584883.718398:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784584883.718400:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584883.718401:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584883.718403:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584883.718404:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584883.718405:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584883.718407:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584883.718408:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584883.718410:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584883.718411:0:14283:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584883.718415:0:14283:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1784584883.718417:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784584883.718418:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584883.718419:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584883.718420:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584883.718421:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584883.718423:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584883.718424:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584883.718425:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584883.718426:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584883.718427:0:14283:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584883.718452:0:14283:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784584883.718464:0:14283:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569031040:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784584883.718497:0:14283:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584883.718513:0:14283:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c732f540 going to sleep for 11 seconds 00000100:00100000:0.0:1784584883.718809:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569031040 00000100:00100000:0.0:1784584883.718814:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569031040 00000100:00100000:0.0:1784584883.718884:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784584883.718891:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14283:x1871272569031040:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784584883.718913:0:14296:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784584883.718934:0:14296:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784584883.777624:0:14296:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784584883.777643:0:14296:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1784584883.777755:0:14317:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784584883.777760:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784584883.777781:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584883.777816:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff204f expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584883.777826:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584883.777866:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff204f expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584883.777879:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff204f expref: 12 pid: 14293 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584883.777892:0:14317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4255500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1871272569031168:0@lo:104: 00000100:00100000:0.0:1784584883.777965:0:14317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584883.778020:0:14317:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcf6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784584883.778095:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569031168 00000100:00100000:3.0:1784584883.778102:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569031168 00000100:00100000:3.0:1784584883.778148:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584883.778157:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:14317:x1871272569031168:12345-0@lo:104: 00010000:00010000:3.0:1784584883.778169:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778219:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584883.778226:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:14317:x1871272569031168:12345-0@lo:104: Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584883.778232:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1784584883.778251:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584883.778281:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778289:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818e00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:3.0:1784584883.778293:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778301:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784584883.778308:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584883.778314:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784584883.778343:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778350:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784584883.778369:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778376:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff204f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2056 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778393:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584883.778395:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584883.778397:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584883.778426:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:978ed13c-6d08-4d66-8bb5-98db460a5248:3323:1871272569031296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584883.778453:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584883.778489:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569031296 00000100:00100000:3.0:1784584883.778499:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569031296 00010000:00010000:3.0:1784584883.778516:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff204f expref: 13 pid: 14293 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584883.778536:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584883.778542:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+13:3323:x1871272569031296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584883.778552:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584883.778556:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff204f expref: 13 pid: 14293 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778566:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff204f expref: 13 pid: 14293 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778581:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778589:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784584883.778602:0:14286:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000842806s 00010000:00010000:3.0:1784584883.778606:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778613:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778620:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778626:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778641:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bfa00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584883.778645:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778652:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778661:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778670:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584883.778734:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2479c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+13:3323:x1871272569031296:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584883.778741:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584883.778775:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:978ed13c-6d08-4d66-8bb5-98db460a5248:3323:1871272569031296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584883.778801:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2056 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff204f expref: 12 pid: 14293 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584883.778811:0:14317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4255500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1871272569031168:0@lo:104: 00010000:00010000:3.0:1784584883.778823:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778832:0:14317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778838:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584883.778854:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bfa00/0x787d778cc3ff2087 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584883.789062:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+11:14283:x1871272569031040:12345-0@lo:253:mount.lustre.0 Request processed in 70161us (70554us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584883.789166:0:14283:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c46680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14283:1871272569031040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784584883.789182:0:14283:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784584883.789185:0:14283:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584883.789187:0:14283:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784584883.789188:0:14283:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584883.789203:0:14283:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584883.789204:0:14283:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584883.789205:0:14283:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584883.789207:0:14283:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784584883.789208:0:14283:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784584883.789210:0:14283:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584883.789212:0:14283:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784584883.789227:0:14283:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1784584883.789546:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00080000:10000000:3.0:1784584883.801554:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584883.801770:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784584883.802051:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584883.802207:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784584883.802462:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584883.802611:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1784584883.806329:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1784584883.806801:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1784584883.807145:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1784584883.807377:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1784584883.808041:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1784584883.808212:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1784584883.848831:0:14283:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1784584883.849344:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1784584883.849778:0:14339:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1784584883.849842:0:14339:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1784584883.852848:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784584883.853009:0:14283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784584883.853413:0:14283:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784584883.853420:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784584883.853537:0:14283:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584883.855437:0:14339:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000020:00080000:2.0:1784584883.855657:0:14338:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1784584883.855662:0:14338:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00080000:0.0:1784584883.856057:0:14339:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1784584883.856061:0:14339:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:1.0:1784584883.857022:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784584883.857938:0:14283:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784584883.857981:0:14283:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1784584883.859875:0:14283:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1784584883.864537:0:14283:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1784584883.952055:0:14283:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784584883.952091:0:14283:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb02341c83988 00100000:10000000:1.0:1784584883.952099:0:14283:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784584883.953537:0:14283:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784584883.953553:0:14283:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784584883.953571:0:14283:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784584883.953586:0:14283:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1784584884.327149:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784584884.764543:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1784584885.211891:0:14298:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1784584885.211899:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97c7f428a800 from 6 10000000:01000000:2.0:1784584885.211904:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1784584885.211961:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584885.211973:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584885.211984:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584885.212013:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569031424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784584885.212086:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584885.212155:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d82e2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584885.214068:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569031424 00000100:00100000:0.0:1784584885.214081:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569031424 00000100:00100000:0.0:1784584885.214184:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784584885.214194:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+11:14298:x1871272569031424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584885.214211:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584885.214230:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff208e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584885.214255:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff208e expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584885.214266:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff208e expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584885.214274:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf600, rc 0) 00000100:00100000:0.0:1784584885.214354:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14298:x1871272569031424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584885.214361:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784584885.214584:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c46680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569031424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584885.214602:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584885.214611:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584885.214679:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569031552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784584885.214750:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584885.214790:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7fbcfde40 going to sleep for 11 seconds 00000100:00100000:1.0:1784584885.214858:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569031552 00000100:00100000:1.0:1784584885.214863:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569031552 00000100:00100000:1.0:1784584885.214892:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784584885.214898:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14298:x1871272569031552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1784584885.214923:0:14296:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1784584885.214939:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1784584885.214942:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1784584885.215026:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14298:x1871272569031552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 127us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584885.215034:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1784584885.216577:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569031552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784584885.216641:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784584885.216652:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584885.216675:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584885.339928:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784584885.789025:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784584886.364976:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584887.387972:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784584887.908358:0:14581:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784584888.414219:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784584888.862156:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584888.862163:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584888.862166:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584888.862169:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584888.862171:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1784584888.862174:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1784584888.862178:0:38:0:(import.c:65:import_set_state_nolock()) ffff97c7e0551000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784584888.862189:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97c7e0551000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1784584888.862210:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c6c2479500 x1871272569031808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784584888.862247:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784584888.862255:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:978ed13c-6d08-4d66-8bb5-98db460a5248:3321:1871272569031680:0@lo:400:kworker.0 00000100:00100000:3.0:1784584888.862314:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584888.862365:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569031680 00000100:00100000:3.0:1784584888.862372:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569031680 00000100:00100000:3.0:1784584888.862408:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584888.862417:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:3321:x1871272569031680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584888.862466:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:3321:x1871272569031680:12345-0@lo:400:kworker.0 Request processed in 50us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584888.862485:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1784584888.862537:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:978ed13c-6d08-4d66-8bb5-98db460a5248:3321:1871272569031680:0@lo:400:kworker.0 00000100:00100000:1.0:1784584888.862611:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272569031808:0@lo:38:kworker.0 00000100:00100000:1.0:1784584888.862681:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584888.862786:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569031808 00000100:00100000:3.0:1784584888.862791:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569031808 00000100:00100000:3.0:1784584888.862818:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584888.862823:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3319:x1871272569031808:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1784584888.862844:0:14303:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:3.0:1784584888.862878:0:14303:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x787d778cc3ff209c 00000004:00100000:3.0:1784584888.862901:0:14303:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784584888.863034:0:14303:0:(import.c:65:import_set_state_nolock()) ffff97c801aea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584888.863074:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1871272569031808:12345-0@lo:38:kworker.0 Request processed in 250us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584888.863080:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1784584888.863244:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c6c2479500 x1871272569031808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584888.863270:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1784584888.863278:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1784584888.863282:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784584888.863284:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7e0551000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784584888.863290:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2479500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3319:1871272569031808:0@lo:38:kworker.0 00010000:00010000:2.0:1784584889.437176:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584890.460981:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784584890.637512:0:14732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6b973a30 20000000:00000080:1.0:1784584890.637535:0:14732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c7f5d14400 uarg=0000000000000000 20000000:01000000:1.0:1784584890.637578:0:14732:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784584890.637587:0:14732:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784584890.637593:0:14732:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784584890.639092:0:14733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1784584890.639275:0:14732:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784584890.657362:0:14732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784584890.657684:0:14732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584890.657748:0:14732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff205d expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584890.657759:0:14732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584890.657840:0:14732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff205d expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584890.657856:0:14732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff205d expref: 11 pid: 14296 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584890.657875:0:14732:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14732:1871272569031936:0@lo:104: 00000100:00100000:0.0:1784584890.657970:0:14732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584890.658109:0:14732:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b180 going to sleep for 11 seconds 00000100:00100000:1.0:1784584890.658630:0:14285:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569031936 00000100:00100000:1.0:1784584890.658640:0:14285:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569031936 00000100:00100000:1.0:1784584890.664659:0:14285:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584890.665509:0:14285:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:978ed13c-6d08-4d66-8bb5-98db460a5248+3:14732:x1871272569031936:12345-0@lo:104: 00010000:00010000:0.0:1784584890.665542:0:14285:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584890.665685:0:14285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584890.665708:0:14285:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:978ed13c-6d08-4d66-8bb5-98db460a5248+3:14732:x1871272569031936:12345-0@lo:104: Request processed in 1017us (7722us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584890.665818:0:14732:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14732:1871272569031936:0@lo:104: 00010000:00010000:1.0:1784584890.665854:0:14732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.666841:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584890.666854:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.666888:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819e00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584890.666893:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.666905:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584890.666914:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584890.666920:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784584890.666979:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.666987:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584890.667015:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667022:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c801819e00/0x787d778cc3ff205d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2064 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667044:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584890.667047:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584890.667048:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584890.667066:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:978ed13c-6d08-4d66-8bb5-98db460a5248:3321:1871272569032064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584890.667136:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584890.667221:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569032064 00000100:00100000:2.0:1784584890.667230:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569032064 00010000:00010000:2.0:1784584890.667266:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff205d expref: 12 pid: 14296 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584890.667308:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584890.667317:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:3321:x1871272569032064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584890.667415:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584890.667423:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff205d expref: 12 pid: 14296 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667436:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff205d expref: 12 pid: 14296 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667452:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff205d expref: 12 pid: 14296 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667472:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667482:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667500:0:14286:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667508:0:14286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667516:0:14286:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667524:0:14286:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667540:0:14286:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bea00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584890.667545:0:14286:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667553:0:14286:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667566:0:14286:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584890.667577:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584890.667615:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+11:3321:x1871272569032064:12345-0@lo:103:ldlm_bl.0 Request processed in 298us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584890.667623:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584890.667667:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:978ed13c-6d08-4d66-8bb5-98db460a5248:3321:1871272569032064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584890.668372:0:14732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584890.668385:0:14732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584890.668392:0:14732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bea00/0x787d778cc3ff20a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584890.674500:0:14285:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1784584891.485042:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584892.519333:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784584892.580362:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784584892.580369:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7f428a800 from 10 10000000:01000000:3.0:1784584892.580375:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784584892.580433:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584892.580446:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584892.580458:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584892.580486:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569032192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784584892.580560:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584892.580604:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8762900 going to sleep for 11 seconds 00000100:00100000:0.0:1784584892.580730:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569032192 00000100:00100000:0.0:1784584892.580738:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569032192 00000100:00100000:0.0:1784584892.580791:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784584892.580801:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+11:14298:x1871272569032192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584892.580815:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584892.580830:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff20aa expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584892.580852:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff20aa expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584892.580885:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff20aa expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584892.580895:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf800, rc 0) 00000100:00100000:0.0:1784584892.580937:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14298:x1871272569032192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584892.580943:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784584892.581115:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569032192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584892.581143:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584892.581152:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584892.581205:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569032320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584892.581230:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584892.581257:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8762900 going to sleep for 11 seconds 00000100:00100000:1.0:1784584892.581340:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569032320 00000100:00100000:1.0:1784584892.581345:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569032320 00000100:00100000:1.0:1784584892.581376:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784584892.581383:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14298:x1871272569032320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584892.581762:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14298:x1871272569032320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 378us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584892.581769:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784584892.582377:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569032320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584892.582435:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569032448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584892.582482:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584892.582510:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8762900 going to sleep for 11 seconds 00000100:00100000:2.0:1784584892.582625:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569032448 00000100:00100000:2.0:1784584892.582631:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569032448 00000100:00100000:2.0:1784584892.582670:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784584892.582678:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14298:x1871272569032448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584892.582857:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14298:x1871272569032448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584892.582874:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784584892.583457:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569032448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784584892.587275:0:14804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1784584892.587547:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1784584892.587569:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784584892.587582:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584892.587612:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584893.535081:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784584893.979821:0:13595:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584893.979828:0:13595:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584893.979831:0:13595:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584893.979834:0:13595:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784584893.979837:0:3319:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584883/real 1784584883] req@ffff97c7f4255180 x1871272569029120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584893 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584893.979877:0:3319:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97c7f4255180 x1871272569029120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584893 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584893.979877:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569032576:0@lo:400:kworker.0 00000100:00100000:3.0:1784584893.979886:0:3319:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584883/real 1784584883] req@ffff97c7f4257100 x1871272569028992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584893 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584893.979908:0:3319:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97c7f4257100 x1871272569028992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584893 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784584893.979923:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7d0348000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584893.979935:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784584893.979939:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4255180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569029120:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784584893.979942:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1784584893.979944:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7c70b2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784584893.979949:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1784584893.979951:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4257100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569028992:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1784584893.979982:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584893.979988:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569032704:0@lo:400:kworker.0 00000100:00100000:2.0:1784584893.980025:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584893.980063:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569032576 00000100:00100000:2.0:1784584893.980070:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569032576 00000100:00100000:2.0:1784584893.980108:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784584893.980116:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:3322:x1871272569032576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584893.980174:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+12:3322:x1871272569032576:12345-0@lo:400:kworker.0 Request processed in 58us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584893.980181:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1784584893.980212:0:13595:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584893.980216:0:13595:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784584893.980218:0:13595:0:(import.c:65:import_set_state_nolock()) ffff97c7c70b2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584893.980223:0:13595:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 378 00000100:00080000:2.0:1784584893.980232:0:13595:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784584893.980237:0:13595:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97c7c70b2000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1784584893.980258:0:13595:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f1c44a80 x1871272569032832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584893.980271:0:13595:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584893.980274:0:13595:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784584893.980276:0:13595:0:(import.c:65:import_set_state_nolock()) ffff97c7d0348000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584893.980278:0:13595:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 378 00000100:00080000:2.0:1784584893.980281:0:13595:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784584893.980285:0:13595:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c7d0348000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1784584893.980295:0:13595:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f1c45c00 x1871272569032960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584893.980313:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569032832:0@lo:8:kworker.0 00000400:00000100:2.0:1784584893.980336:0:3319:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871272569032832 offset 0 length 520: 4 00000100:00100000:2.0:1784584893.980348:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569032960:0@lo:8:kworker.0 00000400:00000100:2.0:1784584893.980361:0:3319:0:(lib-move.c:4322:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1871272569032960 offset 0 length 520: 4 00000100:00100000:2.0:1784584893.980391:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569032576:0@lo:400:kworker.0 00000100:00100000:3.0:1784584893.980639:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569032704 00000100:00100000:3.0:1784584893.980644:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569032704 00000100:00100000:3.0:1784584893.980675:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584893.980682:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569032704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584893.980740:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569032704:12345-0@lo:400:kworker.0 Request processed in 59us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584893.980746:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1784584893.980973:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c7f1c45180 x1871272569032704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584893.980985:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569032704:0@lo:400:kworker.0 00010000:00010000:3.0:1784584894.563028:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784584894.693129:0:14933:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784584894.693133:0:14933:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1784584894.693245:0:14933:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97c7c41a3000 00000020:01000004:1.0:1784584894.693261:0:14933:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1784584894.693272:0:14933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1784584894.693305:0:14933:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97c7faa4cd40) 00000020:00000080:1.0:1784584894.693323:0:14933:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784584894.734984:0:14933:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784584894.735249:0:14933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784584894.741019:0:14933:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784584894.741284:0:14933:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1784584894.743196:0:14933:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784584894.745163:0:14933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1784584894.745294:0:14933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1784584894.747238:0:14933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1784584894.747847:0:14933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 588: rc = 0 00100000:10000000:2.0:1784584894.748088:0:14933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 588: rc = 0 00100000:10000000:2.0:1784584894.748394:0:14933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 588: rc = 0 00100000:10000000:2.0:1784584894.748632:0:14933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 588: rc = 0 00100000:10000000:2.0:1784584894.749677:0:14933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 588: rc = 0 00100000:10000000:2.0:1784584894.750043:0:14933:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 588: rc = 0 00000020:00000080:2.0:1784584894.751059:0:14933:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784584894.751070:0:14933:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784584894.751080:0:14933:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x787d778cc3ff20bf 00000020:01000004:2.0:1784584894.751088:0:14933:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784584894.751109:0:14933:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784584894.751112:0:14933:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784584894.751118:0:14933:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784584894.751123:0:14933:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784584894.751133:0:14933:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97c7c5c60000) 00000020:00000080:2.0:1784584894.751142:0:14933:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1784584894.753917:0:14933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584894.754091:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784584894.754098:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784584894.756551:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784584894.756564:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1784584894.757115:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1784584894.757123:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1784584894.770412:0:14933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584894.770564:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1784584894.770571:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784584894.771217:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784584894.771224:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1784584894.787013:0:14933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784584894.787278:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784584894.787286:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1784584894.788449:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784584894.788458:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1784584894.789455:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1784584894.789463:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1784584894.791653:0:14933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784584894.791913:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1784584894.791920:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1784584894.793000:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1784584894.793009:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1784584894.830194:0:14933:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784584894.833294:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1784584894.833302:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1784584894.836303:0:14933:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1784584894.836316:0:14933:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1784584894.836890:0:14933:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1784584894.836912:0:14933:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1784584894.836918:0:14933:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1784584894.869044:0:14933:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784584894.869094:0:14933:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.152@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1784584894.869099:0:14933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784584894.869101:0:14933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784584894.869102:0:14933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584894.869103:0:14933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784584894.869104:0:14933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584894.869105:0:14933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584894.869106:0:14933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784584894.869107:0:14933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584894.869109:0:14933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784584894.869113:0:14933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1784584894.869115:0:14933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784584894.869117:0:14933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784584894.869118:0:14933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584894.869119:0:14933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784584894.869120:0:14933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584894.869121:0:14933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584894.869122:0:14933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784584894.869127:0:14933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584894.869128:0:14933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784584894.869154:0:14933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784584894.869230:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033088:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784584894.869747:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.869791:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584894.869844:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569033088 00000100:00100000:1.0:1784584894.869861:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569033088 00000100:00100000:1.0:1784584894.869928:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784584894.869938:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14933:x1871272569033088:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784584894.869991:0:14295:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784584894.869994:0:14295:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1784584894.869998:0:14295:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784584894.874596:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14933:x1871272569033088:12345-0@lo:253:mount.lustre.0 Request processed in 4650us (4841us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584894.874611:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784584894.874753:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033088:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784584894.874769:0:14933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784584894.874772:0:14933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784584894.874773:0:14933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784584894.874775:0:14933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584894.874776:0:14933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784584894.874777:0:14933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584894.874779:0:14933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584894.874780:0:14933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784584894.874782:0:14933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584894.874783:0:14933:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784584894.874801:0:14933:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c7c41a3000 from lustre-OST0000 10000000:01000000:0.0:1784584894.874825:0:14933:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784584894.874829:0:14933:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784584894.874834:0:14933:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97c7c7f8b380 local copy 00010000:00010000:0.0:1784584894.874845:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584894.875094:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584894.875131:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.875170:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584894.877559:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569033216 00000100:00100000:2.0:1784584894.877575:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569033216 00000100:00100000:2.0:1784584894.877642:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784584894.877654:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14933:x1871272569033216:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584894.877961:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14933:x1871272569033216:12345-0@lo:501:mount.lustre.0 Request processed in 309us (2828us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784584894.877969:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784584894.878057:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033216:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1784584894.878083:0:14933:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784584894.878263:0:14933:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784584894.878273:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.878289:0:14933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584894.878393:0:14933:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c7c41a3000 10000000:01000000:0.0:1784584894.878398:0:14933:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784584894.878403:0:14933:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97c7c7f8b380 10000000:01000000:0.0:1784584894.878406:0:14933:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1784584894.878410:0:14933:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff97c7c7f8b380 from 1 10000000:01000000:0.0:1784584894.878412:0:14933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1784584894.878446:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42be000/0x787d778cc3ff20cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.878454:0:14933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7f42be000/0x787d778cc3ff20cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.878464:0:14933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7f42be000/0x787d778cc3ff20cd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584894.878483:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784584894.878519:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.878598:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584894.880685:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569033344 00000100:00100000:1.0:1784584894.880771:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569033344 00000100:00100000:1.0:1784584894.880864:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784584894.880874:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+12:14933:x1871272569033344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584894.880890:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584894.880909:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801818c00/0x787d778cc3ff20d4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff20cd expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584894.881534:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801818c00/0x787d778cc3ff20d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff20cd expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584894.881548:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801818c00/0x787d778cc3ff20d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff20cd expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584894.881557:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818c00, rc 0) 00000100:00100000:1.0:1784584894.881739:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+13:14933:x1871272569033344:12345-0@lo:101:mount.lustre.0 Request processed in 866us (3218us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584894.881748:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784584894.881914:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584894.881934:0:14933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7f42be000/0x787d778cc3ff20cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20d4 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.881944:0:14933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7f42be000/0x787d778cc3ff20cd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff20d4 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584894.881982:0:14933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1784584894.882036:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42be000/0x787d778cc3ff20cd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20d4 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.882044:0:14933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7f42be000/0x787d778cc3ff20cd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20d4 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584894.882065:0:14933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784584894.882071:0:14933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784584894.882077:0:14933:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1784584894.882080:0:14933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1784584894.882105:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf400/0x787d778cc3ff20db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.882113:0:14933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf400/0x787d778cc3ff20db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.882121:0:14933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf400/0x787d778cc3ff20db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584894.882138:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784584894.882287:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.882326:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dad80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584894.882579:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569033472 00000100:00100000:2.0:1784584894.882585:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569033472 00000100:00100000:2.0:1784584894.882628:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784584894.882636:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+13:14933:x1871272569033472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584894.882646:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584894.882657:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c7fa3800/0x787d778cc3ff20e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff20db expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584894.882676:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c7fa3800/0x787d778cc3ff20e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff20db expref: 14 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584894.882685:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c7fa3800/0x787d778cc3ff20e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff20db expref: 14 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584894.882707:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3800, rc 0) 00000100:00100000:2.0:1784584894.882755:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569033472:12345-0@lo:101:mount.lustre.0 Request processed in 121us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584894.882762:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784584894.882801:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584894.882814:0:14933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf400/0x787d778cc3ff20db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20e2 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.882821:0:14933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf400/0x787d778cc3ff20db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff20e2 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784584894.883817:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1784584894.887228:0:14933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584894.892027:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1784584894.893781:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1784584894.893827:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1784584894.893907:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1784584894.893950:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1784584894.893985:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1784584894.895226:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1784584894.895244:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1784584894.895351:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584894.895416:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.895465:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584894.895616:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569033600 00000100:00100000:1.0:1784584894.895622:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569033600 00000100:00100000:1.0:1784584894.895671:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784584894.895680:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569033600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584894.896071:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569033600:12345-0@lo:501:mount.lustre.0 Request processed in 391us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584894.896080:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784584894.896350:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584894.896389:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033728:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584894.896442:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.896463:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584894.896618:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569033728 00000100:00100000:1.0:1784584894.896622:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569033728 00000100:00100000:1.0:1784584894.896657:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784584894.896664:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569033728:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784584894.897120:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569033728:12345-0@lo:503:mount.lustre.0 Request processed in 455us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584894.897133:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1784584894.897582:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033728:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784584894.900132:0:14933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584894.900222:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033856:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584894.900294:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584894.900385:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d0722180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584894.900493:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569033856 00000100:00100000:0.0:1784584894.900500:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569033856 00000100:00100000:0.0:1784584894.900591:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1784584894.900600:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569033856:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584894.901012:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569033856:12345-0@lo:502:mount.lustre.0 Request processed in 412us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584894.901025:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784584894.901918:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033856:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584894.902191:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1784584894.902246:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1784584894.902279:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1784584894.902342:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1784584894.902380:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1784584894.902571:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1784584894.902628:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1784584894.902667:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1784584894.902788:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1784584894.902866:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1784584894.902905:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1784584894.902953:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1784584894.902994:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033984:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584894.903054:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584894.903191:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1d6ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584894.903259:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569033984 00000100:00100000:0.0:1784584894.903265:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569033984 00000100:00100000:0.0:1784584894.903319:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1784584894.903328:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569033984:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584894.903520:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569033984:12345-0@lo:502:mount.lustre.0 Request processed in 193us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584894.903528:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784584894.903666:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569033984:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584894.903766:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1784584894.903785:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1784584894.904921:0:14947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1784584894.904931:0:14947:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1784584894.904937:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584894.904940:0:14947:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1784584894.904945:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1784584894.904959:0:14947:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97c7c7f899c0) 00000020:00000080:3.0:1784584894.904980:0:14947:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1784584894.904985:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1784584894.905063:0:14947:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c7c41a3000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1784584894.905071:0:14947:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784584894.905078:0:14947:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x787d778cc3ff20f0 00010000:00010000:3.0:1784584894.912385:0:14947:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1784584894.912974:0:14947:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1784584894.915646:0:14947:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1784584894.917470:0:14947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1784584894.917481:0:14947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584894.917488:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584894.917490:0:14947:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1784584894.917493:0:14947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784584894.917496:0:14947:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1784584894.917498:0:14947:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784584894.917500:0:14947:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784584894.917501:0:14947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784584894.917504:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584894.917505:0:14947:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784584894.917508:0:14947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584894.917511:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584894.917512:0:14947:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1784584894.917515:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1784584894.917518:0:14947:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1784584894.917520:0:14947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584894.917522:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584894.917524:0:14947:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1784584894.917526:0:14947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784584894.917528:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584894.917530:0:14947:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1784584894.917533:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1784584894.917592:0:14947:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784584894.917596:0:14947:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784584894.917597:0:14947:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1784584894.917601:0:14947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1784584894.918062:0:14933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1784584894.918096:0:14933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784584894.918120:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf400/0x787d778cc3ff20db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20e2 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584894.918133:0:14933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7f42bf400/0x787d778cc3ff20db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20e2 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784584894.918142:0:14933:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7c41a3000 from 1 10000000:01000000:3.0:1784584894.918144:0:14933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784584894.918182:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584894.918191:0:14933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584894.918202:0:14933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584894.918239:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784584894.918322:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584894.918354:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584894.918516:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569034112 00000100:00100000:0.0:1784584894.918523:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569034112 00000100:00100000:0.0:1784584894.918570:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1784584894.918579:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+14:14933:x1871272569034112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584894.918592:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584894.918605:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff20f7 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.918629:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff20f7 expref: 15 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.918640:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff20f7 expref: 15 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.918648:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfe00, rc 0) 00000100:00100000:0.0:1784584894.918713:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034112:12345-0@lo:101:mount.lustre.0 Request processed in 135us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584894.918720:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784584894.918915:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584894.918931:0:14933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584894.918940:0:14933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784584894.919549:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784584894.920114:0:14933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784584894.920999:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784584894.921056:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784584894.921123:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784584894.921132:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784584894.921214:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584894.921273:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584894.922073:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebb40 going to sleep for 11 seconds 00000100:00100000:1.0:1784584894.924585:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569034240 00000100:00100000:1.0:1784584894.924599:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569034240 00000100:00100000:1.0:1784584894.926102:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784584894.926117:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584894.926428:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034240:12345-0@lo:501:mount.lustre.0 Request processed in 314us (5154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584894.926436:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784584894.926761:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584894.926811:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584894.926868:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584894.930973:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584894.931013:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569034368 00000100:00100000:0.0:1784584894.931023:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569034368 00000100:00100000:0.0:1784584894.931071:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1784584894.931080:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034368:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584894.931838:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034368:12345-0@lo:503:mount.lustre.0 Request processed in 756us (4967us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584894.931864:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784584894.932030:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1784584894.932967:0:14933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1784584894.933051:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584894.933112:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584894.933244:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569034496 00000100:00100000:2.0:1784584894.933251:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569034496 00000100:00100000:3.0:1784584894.933462:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebb40 going to sleep for 11 seconds 00000100:00100000:2.0:1784584894.933503:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784584894.933513:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584894.933730:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034496:12345-0@lo:502:mount.lustre.0 Request processed in 218us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584894.933737:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784584894.933833:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584894.934078:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1784584894.934125:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1784584894.934179:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1784584894.934215:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1784584894.934244:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1784584894.934287:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1784584894.934333:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1784584894.934364:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1784584894.934570:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584894.934620:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584894.935423:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584894.935525:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569034624 00000100:00100000:0.0:1784584894.935532:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569034624 00000100:00100000:0.0:1784584894.935569:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784584894.935576:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584894.935805:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034624:12345-0@lo:502:mount.lustre.0 Request processed in 228us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584894.935813:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1784584894.935992:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584894.936113:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784584894.936128:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1784584894.937507:0:14951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584894.937519:0:14951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584894.937520:0:14951:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784584894.937527:0:14951:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7c41a3000 00000020:00000080:3.0:1784584894.937530:0:14951:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784584894.937537:0:14951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584894.937539:0:14951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584894.937540:0:14951:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784584894.937543:0:14951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584894.937545:0:14951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584894.937546:0:14951:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784584894.937549:0:14951:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c7c41a3000 00000020:00000080:3.0:1784584894.937556:0:14951:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784584894.937621:0:14951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584894.937625:0:14951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584894.937626:0:14951:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784584894.937629:0:14951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784584894.937632:0:14951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584894.937633:0:14951:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784584894.937637:0:14951:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c7c41a3000 00000020:00000080:3.0:1784584894.937639:0:14951:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784584894.937675:0:14951:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784584894.937678:0:14951:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784584894.937680:0:14951:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784584894.937683:0:14951:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1784584894.939522:0:14933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1784584894.939565:0:14933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784584894.939593:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.939605:0:14933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584894.939651:0:14933:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784584894.939654:0:14933:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c7c41a3000 10000000:01000000:0.0:1784584894.939657:0:14933:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c7c41a3000 10000000:01000000:0.0:1784584894.939660:0:14933:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784584894.939666:0:14933:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c7c41a3000 from 1 10000000:01000000:0.0:1784584894.939668:0:14933:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784584894.939728:0:14933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bfc00/0x787d778cc3ff2105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.939737:0:14933:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7f42bfc00/0x787d778cc3ff2105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.939749:0:14933:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7f42bfc00/0x787d778cc3ff2105 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584894.939781:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784584894.939843:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.939890:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dac00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584894.939914:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569034752 00000100:00100000:0.0:1784584894.939920:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569034752 00000100:00100000:0.0:1784584894.939960:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784584894.939968:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569034752:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584894.939981:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584894.939994:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff210c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff2105 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.940016:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff210c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff2105 expref: 16 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.940026:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bee00/0x787d778cc3ff210c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff2105 expref: 16 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.940034:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bee00, rc 0) 00000100:00100000:0.0:1784584894.940069:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569034752:12345-0@lo:101:mount.lustre.0 Request processed in 101us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584894.940076:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784584894.940113:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584894.940126:0:14933:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7f42bfc00/0x787d778cc3ff2105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff210c expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.940135:0:14933:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7f42bfc00/0x787d778cc3ff2105 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff210c expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784584894.941171:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1784584894.943090:0:14933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584894.944567:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1784584894.944653:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1784584894.946956:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1784584894.947093:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1784584894.947130:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1784584894.947176:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1784584894.947213:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1784584894.947247:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1784584894.947293:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1784584894.947524:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1784584894.947555:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1784584894.947600:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1784584894.947637:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1784584894.947672:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1784584894.951627:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1784584894.951688:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1784584894.951755:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1784584894.951823:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1784584894.951873:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1784584894.951908:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1784584894.951953:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1784584894.951989:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1784584894.952020:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1784584894.952062:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1784584894.952093:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1784584894.952122:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1784584894.952162:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1784584894.952197:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1784584894.952287:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1784584894.952318:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1784584894.952428:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584894.952495:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.952538:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584894.952884:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569034880 00000100:00100000:3.0:1784584894.952892:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569034880 00000100:00100000:3.0:1784584894.952937:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784584894.952946:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569034880:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584894.953170:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569034880:12345-0@lo:501:mount.lustre.0 Request processed in 225us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584894.953178:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1784584894.953894:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569034880:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584894.953939:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569035008:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584894.953986:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.954012:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dac00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584894.954027:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569035008 00000100:00100000:0.0:1784584894.954032:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569035008 00000100:00100000:0.0:1784584894.954068:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784584894.954075:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569035008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584894.954221:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569035008:12345-0@lo:503:mount.lustre.0 Request processed in 145us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584894.954229:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784584894.954267:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569035008:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784584894.956594:0:14933:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784584894.956680:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569035136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584894.957532:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.957577:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569035136 00000100:00100000:0.0:1784584894.957583:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569035136 00000100:00100000:0.0:1784584894.957643:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1784584894.957652:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569035136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584894.957772:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dac00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584894.959148:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569035136:12345-0@lo:502:mount.lustre.0 Request processed in 1490us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584894.959174:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784584894.967050:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569035136:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584894.968868:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1784584894.968945:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1784584894.968976:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1784584894.969039:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1784584894.969077:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1784584894.969120:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1784584894.969152:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1784584894.969183:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1784584894.969241:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1784584894.969273:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1784584894.970859:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1784584894.970964:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1784584894.971000:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1784584894.971032:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1784584894.971080:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1784584894.971114:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1784584894.971166:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1784584894.971214:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1784584894.971247:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1784584894.971278:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1784584894.971645:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1784584894.971686:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1784584894.971761:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1784584894.971822:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1784584894.971872:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1784584894.971907:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1784584894.971953:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1784584894.971988:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1784584894.972021:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1784584894.972063:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1784584894.972094:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1784584894.972123:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1784584894.972168:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1784584894.972211:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1784584894.972243:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1784584894.972283:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1784584894.975427:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1784584894.975494:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1784584894.975570:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1784584894.975609:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1784584894.975662:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569035264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584894.975777:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584894.975819:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569035264 00000100:00100000:3.0:1784584894.975826:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569035264 00000100:00100000:3.0:1784584894.975883:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784584894.975892:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569035264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584894.976104:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569035264:12345-0@lo:502:mount.lustre.0 Request processed in 213us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584894.976112:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1784584894.976161:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c35ebb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784584894.976184:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569035264:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584894.976247:0:14933:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1784584894.976256:0:14933:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1784584894.978998:0:14956:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1784584894.979013:0:14956:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97c7c7f88000) 00000020:00000080:3.0:1784584894.979034:0:14956:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1784584894.979232:0:14956:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c7c41a3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784584894.979236:0:14956:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c7c41a3000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1784584894.979240:0:14956:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c7c41a3000 3 00010000:00080000:3.0:1784584894.979265:0:14956:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c7fe86a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.152@tcp at head 00010000:00010000:3.0:1784584894.983885:0:14956:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1784584894.983982:0:14956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1784584894.984038:0:14956:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784584894.984051:0:14956:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x787d778cc3ff211a 00000100:00080000:3.0:1784584894.984062:0:14956:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1784584894.984067:0:14956:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97c7fe86a800 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:3.0:1784584894.984105:0:14956:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c6c2478380 x1871272569035392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784584894.984143:0:14956:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1784584894.984438:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1871272569035392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584894.984506:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1784584894.984676:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584894.984682:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784584894.984708:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784584894.984712:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784584894.985658:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569035392 00000100:00100000:3.0:1784584894.985668:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569035392 00000100:00100000:3.0:1784584894.985731:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584894.985739:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3319:x1871272569035392:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1784584894.985765:0:14301:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 390 last 0 00000020:00000080:3.0:1784584894.985798:0:14301:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x787d778cc3ff2121 00000004:00100000:3.0:1784584894.985814:0:14301:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1784584894.985860:0:14301:0:(import.c:65:import_set_state_nolock()) ffff97c7d034a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784584894.985930:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1871272569035392:12345-0@lo:38:llog_process_th.0 Request processed in 191us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584894.985938:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1784584894.986083:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c6c2478380 x1871272569035392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584894.986094:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584894.986102:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1784584894.986109:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784584894.986113:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784584894.986116:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7fe86a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784584894.986121:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3319:1871272569035392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584894.986155:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569035520:0@lo:400:kworker.0 00000100:00100000:2.0:1784584894.986190:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.986311:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569035520 00000100:00100000:0.0:1784584894.986316:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569035520 00000100:00100000:0.0:1784584894.986353:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784584894.986361:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569035520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584894.986555:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569035520:12345-0@lo:400:kworker.0 Request processed in 194us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584894.986561:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784584894.986615:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97c7f4254e00 x1871272569035520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584910 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584894.986625:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569035520:0@lo:400:kworker.0 00000040:00080000:3.0:1784584894.987062:0:14956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1784584894.987174:0:14933:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784584894.987204:0:14933:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784584894.987223:0:14933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42bfc00/0x787d778cc3ff2105 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff210c expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584894.987235:0:14933:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7f42bfc00/0x787d778cc3ff2105 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff210c expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784584894.987287:0:14933:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784584894.987290:0:14933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784584894.987291:0:14933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584894.987292:0:14933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784584894.987293:0:14933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584894.987294:0:14933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584894.987296:0:14933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784584894.987306:0:14933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584894.987314:0:14933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784584894.987317:0:14933:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1784584894.987320:0:14933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784584894.987321:0:14933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784584894.987322:0:14933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784584894.987323:0:14933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784584894.987324:0:14933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784584894.987325:0:14933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784584894.987326:0:14933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784584894.987327:0:14933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784584894.987328:0:14933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784584894.987347:0:14933:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784584894.987361:0:14933:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569035648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784584894.987521:0:14933:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584894.987558:0:14933:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c3906600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584894.987606:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569035648 00000100:00100000:2.0:1784584894.987613:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569035648 00000100:00100000:2.0:1784584894.987646:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784584894.987653:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14933:x1871272569035648:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784584894.987675:0:14293:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784584894.987748:0:14293:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000040:00080000:2.0:1784584895.007131:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 20000000:01000000:0.0:1784584895.042350:0:14293:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784584895.042399:0:14293:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784584895.043931:0:14317:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784584895.043939:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784584895.043962:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584895.043981:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff208e expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584895.043990:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584895.044026:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff208e expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584895.044039:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff208e expref: 16 pid: 14295 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584895.044068:0:14317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c247ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1871272569035776:0@lo:104: 00000100:00100000:3.0:1784584895.044127:0:14317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584895.044504:0:14317:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8010dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584895.044559:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569035776 00000100:00100000:0.0:1784584895.044566:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569035776 00000100:00100000:0.0:1784584895.044655:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584895.044664:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:14317:x1871272569035776:12345-0@lo:104: 00010000:00010000:0.0:1784584895.044676:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584895.044754:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584895.044760:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2478700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:14317:x1871272569035776:12345-0@lo:104: Request processed in 98us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584895.044766:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584895.044879:0:14317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c247ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1871272569035776:0@lo:104: 00010000:00010000:3.0:1784584895.044900:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045192:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584895.045298:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045306:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:2.0:1784584895.045311:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045319:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784584895.045327:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584895.045333:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784584895.045397:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045403:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784584895.045419:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045426:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2000/0x787d778cc3ff208e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2095 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045442:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584895.045444:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584895.045447:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584895.045460:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:978ed13c-6d08-4d66-8bb5-98db460a5248:3321:1871272569035904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584895.045494:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584895.045557:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569035904 00000100:00100000:2.0:1784584895.045561:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569035904 00010000:00010000:2.0:1784584895.045581:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff208e expref: 17 pid: 14295 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584895.045719:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584895.045727:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:978ed13c-6d08-4d66-8bb5-98db460a5248+17:3321:x1871272569035904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584895.045737:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584895.045742:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff208e expref: 17 pid: 14295 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045753:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff208e expref: 17 pid: 14295 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045765:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2095 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff208e expref: 17 pid: 14295 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045777:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045786:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784584895.045799:0:14288:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001860911s 00010000:00010000:2.0:1784584895.045804:0:14288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045811:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045818:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045830:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045836:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584895.045840:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045847:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045872:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045881:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584895.045909:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:978ed13c-6d08-4d66-8bb5-98db460a5248+16:3321:x1871272569035904:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584895.045916:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584895.045946:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:978ed13c-6d08-4d66-8bb5-98db460a5248:3321:1871272569035904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784584895.045984:0:14317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045992:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584895.045998:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff2128 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584895.057434:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14933:x1871272569035648:12345-0@lo:253:mount.lustre.0 Request processed in 69771us (69903us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584895.057449:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1784584895.057601:0:14933:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:14933:1871272569035648:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784584895.057616:0:14933:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1784584895.057620:0:14933:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784584895.057622:0:14933:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1784584895.057623:0:14933:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584895.057625:0:14933:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584895.057626:0:14933:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584895.057628:0:14933:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584895.057629:0:14933:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584895.057631:0:14933:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584895.057632:0:14933:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784584895.057645:0:14933:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784584895.064458:0:14933:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584895.064632:0:14933:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784584895.064873:0:14933:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584895.065044:0:14933:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784584895.065196:0:14933:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1784584895.065406:0:14933:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1784584895.067035:0:14933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1784584895.147042:0:14933:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1784584895.147051:0:14933:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1784584895.147081:0:14933:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784584895.147140:0:14933:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784584895.147153:0:14933:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1784584895.147191:0:14933:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784584895.579881:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784584896.355819:0:14298:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784584896.355827:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97c7f428a800 from 7 10000000:01000000:1.0:1784584896.355832:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584896.355885:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584896.355898:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584896.355909:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584896.355937:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569036032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584896.356004:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584896.356545:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c930c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584896.360524:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569036032 00000100:00100000:2.0:1784584896.360540:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569036032 00000100:00100000:2.0:1784584896.360603:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784584896.360613:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+15:14298:x1871272569036032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584896.360631:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584896.360651:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff212f expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584896.360679:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff212f expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584896.360704:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff212f expref: 16 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584896.360715:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3400, rc 0) 00000100:00100000:2.0:1784584896.360789:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14298:x1871272569036032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (4785us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584896.360796:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784584896.360864:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569036032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584896.360881:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584896.360890:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584896.360955:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569036160:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1784584896.360993:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584896.361022:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1784584896.382477:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569036160 00000100:00100000:0.0:1784584896.382497:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569036160 00000100:00100000:0.0:1784584896.382558:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784584896.382568:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14298:x1871272569036160:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784584896.382593:0:14293:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784584896.382606:0:14293:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784584896.382609:0:14293:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1784584896.382764:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14298:x1871272569036160:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 197us (21769us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584896.382772:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784584896.382920:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569036160:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784584896.382987:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784584896.382996:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584896.383007:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584896.603859:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584897.627956:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584898.653501:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584899.680935:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784584900.134064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584900.134071:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1784584900.134079:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784584900.134082:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784584900.134090:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c247ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569036288:0@lo:400:kworker.0 00000100:00100000:3.0:1784584900.134150:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569036416:0@lo:400:kworker.0 00000100:00100000:1.0:1784584900.134156:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584900.134242:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569036288 00000100:00100000:2.0:1784584900.134249:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569036288 00000100:00100000:2.0:1784584900.134294:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1784584900.134302:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+16:3322:x1871272569036288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584900.134350:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+16:3322:x1871272569036288:12345-0@lo:400:kworker.0 Request processed in 49us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584900.134357:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1784584900.134625:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c247ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569036288:0@lo:400:kworker.0 00000100:00100000:3.0:1784584900.134877:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584900.134910:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569036544:0@lo:400:kworker.0 00000100:00100000:3.0:1784584900.134937:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584900.134982:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569036416 00000100:00100000:3.0:1784584900.134986:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569036416 00000100:00100000:3.0:1784584900.135011:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569036544 00000100:00100000:3.0:1784584900.135014:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569036544 00000100:00100000:1.0:1784584900.135037:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784584900.135046:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569036416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584900.135048:0:14301:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784584900.135054:0:14301:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784584900.135067:0:14303:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784584900.135076:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784584900.135082:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569036544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584900.135084:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569036416:12345-0@lo:400:kworker.0 Request processed in 40us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584900.135089:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584900.135114:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569036544:12345-0@lo:400:kworker.0 Request processed in 31us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584900.135120:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1784584900.135120:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784584900.136647:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c6c2478e00 x1871272569036416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584900.136666:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569036416:0@lo:400:kworker.0 00010000:00080000:3.0:1784584900.138002:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c6c2478380 x1871272569036544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584900.138018:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569036544:0@lo:400:kworker.0 00010000:00010000:1.0:1784584900.699765:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784584901.674594:0:15301:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1784584901.725092:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584902.748401:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584903.772926:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584904.797525:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584905.244526:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1784584905.245187:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584905.245192:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784584905.245195:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784584905.245198:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784584905.245258:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569036800:0@lo:400:kworker.0 00000100:00100000:1.0:1784584905.245328:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584905.245392:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584905.245399:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569036928:0@lo:400:kworker.0 00000100:00100000:1.0:1784584905.245433:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584905.245470:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569036800 00000100:00100000:1.0:1784584905.245477:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569036800 00000100:00100000:1.0:1784584905.245540:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569036928 00000100:00100000:1.0:1784584905.245544:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569036928 00000100:00100000:1.0:1784584905.245574:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584905.245581:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569036800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584905.245630:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569036800:12345-0@lo:400:kworker.0 Request processed in 48us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584905.245637:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584905.245667:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784584905.245673:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569036928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584905.245720:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871272569036928:12345-0@lo:400:kworker.0 Request processed in 47us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584905.245727:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1784584905.245741:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784584905.245766:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8010bfb80 x1871272569036928/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584905.245779:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3322:1871272569036928:0@lo:400:kworker.0 00010000:00080000:1.0:1784584905.245803:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c8010bd880 x1871272569036800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584905.245812:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569036800:0@lo:400:kworker.0 00000100:00100000:3.0:1784584905.245898:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:978ed13c-6d08-4d66-8bb5-98db460a5248:3321:1871272569036672:0@lo:400:kworker.0 00000100:00100000:3.0:1784584905.245938:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584905.246037:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569036672 00000100:00100000:1.0:1784584905.246041:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569036672 00000100:00100000:1.0:1784584905.246159:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1784584905.246167:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:3321:x1871272569036672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584905.246211:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:3321:x1871272569036672:12345-0@lo:400:kworker.0 Request processed in 45us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584905.246218:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784584905.246278:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:978ed13c-6d08-4d66-8bb5-98db460a5248:3321:1871272569036672:0@lo:400:kworker.0 00010000:00010000:0.0:1784584905.822726:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584906.845942:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784584907.792127:0:15602:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1784584907.792131:0:15602:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1784584907.792534:0:15602:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff97c6c2145800 00000020:01000004:1.0:1784584907.792550:0:15602:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1784584907.792563:0:15602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1784584907.792575:0:15602:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97c7faa4b380) 00000020:00000080:1.0:1784584907.792594:0:15602:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1784584907.823889:0:15602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784584907.824150:0:15602:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1784584907.825099:0:15602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784584907.825467:0:15602:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1784584907.825952:0:15602:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1784584907.826435:0:15602:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 247: rc = 0 00100000:10000000:2.0:1784584907.826531:0:15602:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 247: rc = 0 00100000:10000000:2.0:1784584907.826657:0:15602:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 247: rc = 0 00100000:10000000:2.0:1784584907.827290:0:15602:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 619: rc = 0 00100000:10000000:2.0:1784584907.827600:0:15602:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 619: rc = 0 00100000:10000000:2.0:1784584907.827982:0:15602:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 619: rc = 0 00100000:10000000:2.0:1784584907.828366:0:15602:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 619: rc = 0 00100000:10000000:2.0:1784584907.828611:0:15602:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 619: rc = 0 00100000:10000000:2.0:1784584907.828944:0:15602:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 619: rc = 0 00000020:00000080:2.0:1784584907.829606:0:15602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1784584907.829618:0:15602:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784584907.829634:0:15602:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x787d778cc3ff2144 00000020:01000004:2.0:1784584907.829642:0:15602:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1784584907.829662:0:15602:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.152@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784584907.829666:0:15602:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.152@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784584907.829671:0:15602:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1784584907.829921:0:15602:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1784584907.829926:0:15602:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.152@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1784584907.840405:0:15602:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.152@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784584907.840445:0:15602:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.152@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1784584907.840450:0:15602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784584907.840451:0:15602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784584907.840453:0:15602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584907.840454:0:15602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584907.840456:0:15602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584907.840457:0:15602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584907.840458:0:15602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584907.840460:0:15602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584907.840462:0:15602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584907.840466:0:15602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1784584907.840468:0:15602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784584907.840470:0:15602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784584907.840471:0:15602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584907.840472:0:15602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584907.840473:0:15602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584907.840474:0:15602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584907.840475:0:15602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584907.840476:0:15602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584907.840477:0:15602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784584907.840503:0:15602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1784584907.840524:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784584907.840592:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584907.840641:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1784584907.840808:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569037056 00000100:00100000:0.0:1784584907.840816:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569037056 00000100:00100000:0.0:1784584907.840863:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1784584907.840873:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+16:15602:x1871272569037056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784584907.840914:0:14295:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1784584907.840917:0:14295:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1784584907.840921:0:14295:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1784584907.851183:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+16:15602:x1871272569037056:12345-0@lo:253:mount.lustre.0 Request processed in 10302us (10581us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584907.851209:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784584907.851371:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037056:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784584907.851385:0:15602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1784584907.851388:0:15602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784584907.851390:0:15602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1784584907.851391:0:15602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784584907.851392:0:15602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784584907.851393:0:15602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784584907.851394:0:15602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784584907.851395:0:15602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1784584907.851404:0:15602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784584907.851405:0:15602:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784584907.851427:0:15602:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97c6c2145800 from lustre-OST0001 10000000:01000000:3.0:1784584907.851451:0:15602:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1784584907.851453:0:15602:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1784584907.851460:0:15602:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97c7c7f8b380 local copy 00010000:00010000:3.0:1784584907.851470:0:15602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584907.851674:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784584907.851747:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584907.851790:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584907.851934:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569037184 00000100:00100000:1.0:1784584907.851939:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569037184 00000100:00100000:1.0:1784584907.851980:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1784584907.851988:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:15602:x1871272569037184:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584907.852541:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:15602:x1871272569037184:12345-0@lo:501:mount.lustre.0 Request processed in 552us (791us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784584907.852548:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1784584907.852646:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037184:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1784584907.852661:0:15602:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.152@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784584907.852859:0:15602:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.152@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784584907.852866:0:15602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584907.852875:0:15602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801818800/0x787d778cc3ff1fb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff1fbc expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784584907.852896:0:15602:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97c6c2145800 10000000:01000000:2.0:1784584907.852901:0:15602:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784584907.852906:0:15602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1784584907.852908:0:15602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784584907.852912:0:15602:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1784584907.852914:0:15602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1784584907.852937:0:15602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2600/0x787d778cc3ff214b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584907.852945:0:15602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2600/0x787d778cc3ff214b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584907.852952:0:15602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2600/0x787d778cc3ff214b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584907.852978:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037312:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784584907.853009:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.853037:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8350840 going to sleep for 11 seconds 00000100:00100000:1.0:1784584907.853122:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569037312 00000100:00100000:1.0:1784584907.853127:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569037312 00000100:00100000:1.0:1784584907.853161:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784584907.853168:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+16:15602:x1871272569037312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584907.853179:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584907.853192:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801819e00/0x787d778cc3ff2152 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff214b expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.853211:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801819e00/0x787d778cc3ff2152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff214b expref: 17 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.853333:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801819e00/0x787d778cc3ff2152 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff214b expref: 17 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.853342:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801819e00, rc 0) 00000100:00100000:1.0:1784584907.853379:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037312:12345-0@lo:101:mount.lustre.0 Request processed in 211us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584907.853385:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784584907.853499:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037312:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784584907.853511:0:15602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2600/0x787d778cc3ff214b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2152 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584907.853520:0:15602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2600/0x787d778cc3ff214b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff2152 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584907.856410:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1784584907.857505:0:15602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784584907.858365:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1784584907.858416:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1784584907.858444:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1784584907.858483:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1784584907.858512:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1784584907.858538:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1784584907.858592:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1784584907.858599:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1784584907.858680:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584907.859630:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.859670:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8350c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584907.859887:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569037440 00000100:00100000:0.0:1784584907.859895:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569037440 00000100:00100000:0.0:1784584907.859994:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1784584907.860004:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584907.860476:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037440:12345-0@lo:501:mount.lustre.0 Request processed in 474us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584907.860484:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1784584907.860896:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584907.860942:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037568:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584907.860988:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.861058:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8350c00 going to sleep for 11 seconds 00010000:00010000:2.0:1784584907.868238:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584907.869330:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569037568 00000100:00100000:3.0:1784584907.869342:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569037568 00000100:00100000:3.0:1784584907.869406:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784584907.869416:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037568:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784584907.869824:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037568:12345-0@lo:503:mount.lustre.0 Request processed in 409us (8836us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584907.869833:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784584907.869962:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037568:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784584907.870736:0:15602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584907.870822:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584907.870884:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.870918:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8350c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584907.871361:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569037696 00000100:00100000:3.0:1784584907.871368:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569037696 00000100:00100000:3.0:1784584907.871412:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1784584907.871420:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037696:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784584907.871632:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037696:12345-0@lo:502:mount.lustre.0 Request processed in 212us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584907.871639:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784584907.871967:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784584907.872199:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1784584907.872451:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1784584907.872485:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1784584907.872531:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1784584907.872566:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1784584907.872598:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1784584907.872641:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1784584907.872676:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1784584907.872990:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1784584907.873032:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584907.873094:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584907.873130:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2b840 going to sleep for 11 seconds 00000100:00100000:2.0:1784584907.873184:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569037824 00000100:00100000:2.0:1784584907.873191:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569037824 00000100:00100000:2.0:1784584907.873277:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784584907.873285:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d13bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584907.873472:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d13bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037824:12345-0@lo:502:mount.lustre.0 Request processed in 187us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584907.873480:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1784584907.873649:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037824:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584907.873750:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1784584907.873760:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1784584907.874789:0:15603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784584907.874797:0:15603:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1784584907.874803:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584907.874806:0:15603:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1784584907.874811:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784584907.874825:0:15603:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97c7c5d48000) 00000020:00000080:0.0:1784584907.874845:0:15603:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1784584907.874850:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784584907.874911:0:15603:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c6c2145800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1784584907.874919:0:15603:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1784584907.874926:0:15603:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x787d778cc3ff2160 00010000:00010000:1.0:1784584907.879559:0:15603:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1784584907.880201:0:15603:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1784584907.882631:0:15603:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1784584907.884145:0:15603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784584907.884156:0:15603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584907.884162:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584907.884164:0:15603:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1784584907.884169:0:15603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584907.884173:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584907.884174:0:15603:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784584907.884177:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784584907.884179:0:15603:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784584907.884181:0:15603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584907.884183:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584907.884185:0:15603:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784584907.884187:0:15603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784584907.884190:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584907.884191:0:15603:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784584907.884194:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784584907.885872:0:15603:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784584907.885881:0:15603:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784584907.885883:0:15603:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784584907.885889:0:15603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1784584907.890390:0:15602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1784584907.890439:0:15602:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784584907.890503:0:15602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2600/0x787d778cc3ff214b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2152 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.890515:0:15602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7c7fa2600/0x787d778cc3ff214b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2152 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584907.890522:0:15602:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c6c2145800 from 1 10000000:01000000:1.0:1784584907.890524:0:15602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584907.890562:0:15602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.890569:0:15602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.890593:0:15602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584907.890618:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037952:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784584907.890680:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584907.890736:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171780 going to sleep for 11 seconds 00000100:00100000:3.0:1784584907.890814:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569037952 00000100:00100000:3.0:1784584907.890822:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569037952 00000100:00100000:3.0:1784584907.890869:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1784584907.890883:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d13be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+17:15602:x1871272569037952:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784584907.890897:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584907.890908:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff2167 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.890930:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff2167 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.890940:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff2167 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.890948:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec000, rc 0) 00000100:00100000:3.0:1784584907.890987:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d13be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569037952:12345-0@lo:101:mount.lustre.0 Request processed in 105us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584907.890994:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784584907.892163:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569037952:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584907.892184:0:15602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.892195:0:15602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784584907.892743:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1784584907.893198:0:15602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784584907.893424:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1784584907.893469:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1784584907.893527:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1784584907.893536:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1784584907.893615:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038080:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584907.893676:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584907.893745:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7f4171780 going to sleep for 11 seconds 00000100:00100000:2.0:1784584907.894248:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569038080 00000100:00100000:2.0:1784584907.894254:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569038080 00000100:00100000:2.0:1784584907.894305:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784584907.894313:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d13bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569038080:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584907.894524:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d13bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569038080:12345-0@lo:501:mount.lustre.0 Request processed in 212us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584907.894532:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784584907.894578:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784584907.894613:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784584907.894652:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.894669:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8350f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584907.894819:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569038208 00000100:00100000:0.0:1784584907.894825:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569038208 00000100:00100000:0.0:1784584907.894851:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1784584907.894857:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d13bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569038208:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584907.895060:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d13bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569038208:12345-0@lo:503:mount.lustre.0 Request processed in 203us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584907.895074:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784584907.895207:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038208:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1784584907.896409:0:15602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784584907.896491:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584907.896866:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.896938:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7f66d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584907.898792:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569038336 00000100:00100000:0.0:1784584907.898806:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569038336 00000100:00100000:0.0:1784584907.898858:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1784584907.898868:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d13be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569038336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584907.899143:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d13be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569038336:12345-0@lo:502:mount.lustre.0 Request processed in 277us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584907.899156:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1784584907.901910:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784584907.902380:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1784584907.902449:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1784584907.902954:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1784584907.903003:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1784584907.903036:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1784584907.903083:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1784584907.903131:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1784584907.903166:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1784584907.903207:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584907.903874:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.903957:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7f66d80 going to sleep for 11 seconds 00000100:00100000:0.0:1784584907.907366:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569038464 00000100:00100000:0.0:1784584907.907379:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569038464 00000100:00100000:1.0:1784584907.911453:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784584907.911467:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d84f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569038464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584907.911752:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d84f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569038464:12345-0@lo:502:mount.lustre.0 Request processed in 287us (7878us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584907.911781:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784584907.911880:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1784584907.912027:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1784584907.912043:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1784584907.915594:0:15607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584907.915607:0:15607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584907.915609:0:15607:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784584907.915617:0:15607:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c6c2145800 00000020:00000080:0.0:1784584907.915619:0:15607:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584907.915627:0:15607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584907.915630:0:15607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584907.915631:0:15607:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784584907.915634:0:15607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584907.915637:0:15607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584907.915638:0:15607:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784584907.915641:0:15607:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff97c6c2145800 00000020:00000080:0.0:1784584907.915643:0:15607:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584907.915717:0:15607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584907.915721:0:15607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584907.915722:0:15607:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784584907.915725:0:15607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784584907.915727:0:15607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584907.915728:0:15607:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784584907.915732:0:15607:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97c6c2145800 00000020:00000080:0.0:1784584907.915742:0:15607:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784584907.915793:0:15607:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784584907.915797:0:15607:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784584907.915799:0:15607:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784584907.915802:0:15607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1784584907.918763:0:15602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1784584907.918816:0:15602:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784584907.918831:0:15602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.918844:0:15602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584907.918901:0:15602:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784584907.918904:0:15602:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97c6c2145800 10000000:01000000:0.0:1784584907.918907:0:15602:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97c6c2145800 10000000:01000000:0.0:1784584907.918911:0:15602:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784584907.918917:0:15602:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff97c6c2145800 from 1 10000000:01000000:0.0:1784584907.918919:0:15602:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784584907.918952:0:15602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42be200/0x787d778cc3ff2175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.918962:0:15602:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7f42be200/0x787d778cc3ff2175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.918974:0:15602:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7f42be200/0x787d778cc3ff2175 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584907.918998:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784584907.919065:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584907.919111:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00000100:00100000:1.0:1784584907.919184:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569038592 00000100:00100000:1.0:1784584907.919192:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569038592 00000100:00100000:1.0:1784584907.919854:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784584907.919867:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d84f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569038592:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784584907.919882:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584907.919898:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c801818400/0x787d778cc3ff217c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff2175 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.919920:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c801818400/0x787d778cc3ff217c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff2175 expref: 19 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.919931:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c801818400/0x787d778cc3ff217c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff2175 expref: 19 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584907.919939:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c801818400, rc 0) 00000100:00100000:1.0:1784584907.919988:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d84f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569038592:12345-0@lo:101:mount.lustre.0 Request processed in 124us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584907.919994:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1784584907.920078:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784584907.920093:0:15602:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7f42be200/0x787d778cc3ff2175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff217c expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.920102:0:15602:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7f42be200/0x787d778cc3ff2175 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff217c expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784584907.920733:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1784584907.921064:0:15602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584907.921285:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1784584907.921327:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1784584907.921358:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1784584907.921404:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1784584907.921440:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1784584907.921485:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1784584907.921519:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1784584907.921552:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1784584907.921600:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1784584907.921634:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1784584907.921665:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1784584907.921739:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1784584907.921788:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1784584907.921824:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1784584907.921870:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1784584907.921905:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1784584907.921936:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1784584907.921981:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1784584907.922016:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1784584907.922048:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1784584907.922095:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1784584907.922129:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1784584907.922163:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1784584907.922232:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1784584907.922269:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1784584907.922298:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1784584907.922349:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1784584907.922385:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1784584907.922419:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1784584907.922469:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1784584907.922506:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1784584907.922540:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1784584907.922572:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1784584907.922615:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1784584907.922649:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1784584907.922742:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1784584907.922791:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1784584907.922874:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1784584907.922882:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1784584907.922969:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584907.923029:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584907.923071:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00000100:00100000:1.0:1784584907.924997:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569038720 00000100:00100000:1.0:1784584907.925010:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569038720 00000100:00100000:1.0:1784584907.925064:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1784584907.925074:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569038720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784584907.925489:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569038720:12345-0@lo:501:mount.lustre.0 Request processed in 415us (2458us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584907.925496:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784584907.930085:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784584907.930144:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584907.930226:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584907.930269:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569038848 00000100:00100000:0.0:1784584907.930275:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569038848 00000100:00100000:0.0:1784584907.932163:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784584907.932180:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569038848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784584907.932608:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569038848:12345-0@lo:503:mount.lustre.0 Request processed in 434us (2392us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584907.932616:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784584907.932684:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00000100:00100000:0.0:1784584907.932729:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038848:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1784584907.934465:0:15602:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784584907.934544:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038976:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584907.934614:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584907.934655:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00000100:00100000:1.0:1784584907.935394:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569038976 00000100:00100000:1.0:1784584907.935411:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569038976 00000100:00100000:1.0:1784584907.935456:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784584907.935465:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569038976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784584907.936947:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569038976:12345-0@lo:502:mount.lustre.0 Request processed in 1476us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584907.936960:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784584907.937403:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569038976:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584907.937726:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1784584907.942382:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1784584907.942453:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1784584907.942524:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1784584907.942560:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1784584907.942603:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1784584907.942635:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1784584907.942666:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1784584907.942741:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1784584907.942793:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1784584907.942842:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1784584907.942904:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1784584907.942941:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1784584907.942969:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1784584907.943015:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1784584907.943049:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1784584907.943079:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1784584907.943124:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1784584907.943160:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1784584907.943193:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1784584907.943463:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1784584907.943500:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1784584907.943533:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1784584907.943593:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1784584907.943626:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1784584907.943658:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1784584907.945443:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1784584907.945506:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1784584907.945536:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1784584907.945576:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1784584907.945606:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1784584907.945634:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1784584907.945661:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1784584907.945718:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1784584907.945756:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1784584907.945816:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1784584907.945848:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1784584907.945876:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1784584907.945914:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1784584907.945943:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1784584907.945986:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569039104:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784584907.946059:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584907.946108:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8798600 going to sleep for 11 seconds 00000100:00100000:2.0:1784584907.946237:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569039104 00000100:00100000:2.0:1784584907.946244:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569039104 00000100:00100000:2.0:1784584907.946292:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1784584907.946301:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569039104:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784584907.946518:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569039104:12345-0@lo:502:mount.lustre.0 Request processed in 218us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584907.946526:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784584907.948866:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569039104:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784584907.948993:0:15602:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1784584907.949006:0:15602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1784584907.955540:0:15612:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1784584907.955557:0:15612:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97c7c5c619c0) 00000020:00000080:2.0:1784584907.955576:0:15612:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1784584907.955742:0:15612:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97c6c2145800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784584907.955746:0:15612:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97c6c2145800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1784584907.955748:0:15612:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97c6c2145800 3 00010000:00080000:2.0:1784584907.955907:0:15612:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97c6c1185000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.152@tcp at head 00010000:00010000:2.0:1784584907.958228:0:15612:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1784584907.958335:0:15612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784584907.958610:0:15612:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784584907.958622:0:15612:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x787d778cc3ff218a 00000100:00080000:2.0:1784584907.958632:0:15612:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1784584907.958638:0:15612:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97c6c1185000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1784584907.958671:0:15612:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f1c45880 x1871272569039232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584907.958726:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1871272569039232:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1784584907.958846:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.958915:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569039232 00000100:00100000:2.0:1784584907.958922:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569039232 00000100:00100000:2.0:1784584907.958951:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584907.958957:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3319:x1871272569039232:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1784584907.958979:0:14302:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 403 last 0 00000020:00000080:2.0:1784584907.959010:0:14302:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x787d778cc3ff2191 00000004:00100000:2.0:1784584907.959024:0:14302:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784584907.959064:0:14302:0:(import.c:65:import_set_state_nolock()) ffff97c6c27da800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584907.959111:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1871272569039232:12345-0@lo:38:llog_process_th.0 Request processed in 151us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584907.959118:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1784584907.959225:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c7f1c45880 x1871272569039232/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1784584917 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584907.959234:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584907.959242:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1784584907.959248:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784584907.959252:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784584907.959255:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c6c1185000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784584907.959261:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3319:1871272569039232:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1784584907.959317:0:15612:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784584907.959339:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584907.959344:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784584907.959346:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584907.959456:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784584907.959501:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569039360:0@lo:400:kworker.0 00000100:00100000:2.0:1784584907.959529:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.959549:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784584907.959554:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569039488:0@lo:400:kworker.0 00000100:00100000:2.0:1784584907.959575:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584907.959763:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569039360 00000100:00100000:3.0:1784584907.959817:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569039360 00000100:00100000:0.0:1784584907.959835:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569039488 00000100:00100000:0.0:1784584907.959839:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569039488 00000100:00100000:3.0:1784584907.959859:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584907.959866:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569039360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584907.959868:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784584907.959874:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569039488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584907.960064:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569039360:12345-0@lo:400:kworker.0 Request processed in 197us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584907.960064:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569039488:12345-0@lo:400:kworker.0 Request processed in 189us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584907.960071:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584907.960080:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1784584907.960099:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784584907.960110:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c7f1c44700 x1871272569039488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584907.960131:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569039488:0@lo:400:kworker.0 00010000:00080000:3.0:1784584907.960145:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97c7f1c45880 x1871272569039360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584907.960153:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569039360:0@lo:400:kworker.0 00000040:00080000:2.0:1784584907.961072:0:15612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1784584907.961745:0:15602:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1784584907.961999:0:15602:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784584907.962019:0:15602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7f42be200/0x787d778cc3ff2175 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff217c expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584907.962031:0:15602:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7f42be200/0x787d778cc3ff2175 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff217c expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784584907.962087:0:15602:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784584907.962089:0:15602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784584907.962090:0:15602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584907.962092:0:15602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584907.962093:0:15602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584907.962094:0:15602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584907.962096:0:15602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784584907.962098:0:15602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584907.962099:0:15602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584907.962103:0:15602:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1784584907.962106:0:15602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784584907.962108:0:15602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784584907.962109:0:15602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584907.962110:0:15602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584907.962111:0:15602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584907.962112:0:15602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584907.962113:0:15602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784584907.962114:0:15602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584907.962119:0:15602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784584907.962145:0:15602:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784584907.962162:0:15602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569039616:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784584907.962421:0:15602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584907.962463:0:15602:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c7f66c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584907.963155:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569039616 00000100:00100000:1.0:1784584907.963163:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569039616 00000100:00100000:1.0:1784584907.963380:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784584907.963390:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+19:15602:x1871272569039616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784584907.963422:0:14293:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784584907.963437:0:14293:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1784584907.985971:0:14293:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784584907.985990:0:14293:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784584907.986086:0:14317:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784584907.986092:0:14317:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784584907.986114:0:14317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.986132:0:14317:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff212f expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.986141:0:14317:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.986180:0:14317:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff212f expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.986194:0:14317:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff212f expref: 19 pid: 14295 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584907.986208:0:14317:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1871272569039744:0@lo:104: 00000100:00100000:3.0:1784584907.986393:0:14317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584907.986471:0:14317:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7e02fc480 going to sleep for 11 seconds 00000100:00100000:0.0:1784584907.991610:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569039744 00000100:00100000:0.0:1784584907.991625:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569039744 00000100:00100000:0.0:1784584907.991708:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584907.991719:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:14317:x1871272569039744:12345-0@lo:104: 00010000:00010000:0.0:1784584907.991736:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.991855:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584907.991861:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:14317:x1871272569039744:12345-0@lo:104: Request processed in 145us (5469us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584907.991869:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1784584907.991887:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584907.991893:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.991902:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818000 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584907.991907:0:14289:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.991917:0:14289:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584907.991925:0:14289:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584907.991932:0:14289:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784584907.991966:0:14289:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.991984:0:14289:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584907.992003:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992010:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c801818000/0x787d778cc3ff212f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff2136 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992025:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584907.992027:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584907.992028:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584907.992049:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569039872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784584907.992395:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584907.992454:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569039872 00000100:00100000:0.0:1784584907.992458:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569039872 00010000:00010000:0.0:1784584907.992477:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff212f expref: 20 pid: 14295 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584907.992500:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784584907.992507:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:978ed13c-6d08-4d66-8bb5-98db460a5248+20:3322:x1871272569039872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584907.992517:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584907.992522:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff212f expref: 20 pid: 14295 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992534:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff212f expref: 20 pid: 14295 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992555:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992572:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784584907.992586:0:14288:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006495222s 00010000:00010000:0.0:1784584907.992591:0:14288:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992598:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992604:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992610:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992616:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaedc00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584907.992620:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992627:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992635:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584907.992648:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584907.992677:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4257480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:978ed13c-6d08-4d66-8bb5-98db460a5248+20:3322:x1871272569039872:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584907.992684:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784584907.992938:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569039872:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584907.993453:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c7fa3400/0x787d778cc3ff2136 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff212f expref: 19 pid: 14295 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584907.993466:0:14317:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14317:1871272569039744:0@lo:104: 00010000:00010000:3.0:1784584907.993491:0:14317:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.993499:0:14317:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.993505:0:14317:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584907.993510:0:14317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2198 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14317 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584907.994436:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+18:15602:x1871272569039616:12345-0@lo:253:mount.lustre.0 Request processed in 31044us (32011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584907.994447:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784584907.994531:0:15602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c46a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:978ed13c-6d08-4d66-8bb5-98db460a5248:15602:1871272569039616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784584907.994545:0:15602:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784584907.994548:0:15602:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784584907.994550:0:15602:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784584907.994551:0:15602:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784584907.994552:0:15602:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784584907.994553:0:15602:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784584907.994554:0:15602:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784584907.994556:0:15602:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784584907.994557:0:15602:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784584907.994558:0:15602:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784584907.994570:0:15602:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784584908.001054:0:15602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784584908.001388:0:15602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784584908.001551:0:15602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784584908.001736:0:15602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784584908.002169:0:15602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784584908.002522:0:15602:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1784584908.003211:0:15602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1784584908.054596:0:15602:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1784584908.054604:0:15602:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1784584908.054640:0:15602:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1784584908.054727:0:15602:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.152@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1784584908.054742:0:15602:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1784584908.054775:0:15602:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1784584908.891883:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584909.022534:0:3319:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584893/real 1784584893] req@ffff97c7f1c44a80 x1871272569032832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584908 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584909.022564:0:3319:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97c7f1c44a80 x1871272569032832/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584908 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584909.022574:0:3319:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784584893/real 1784584893] req@ffff97c7f1c45c00 x1871272569032960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584908 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584909.022603:0:3319:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97c7f1c45c00 x1871272569032960/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1784584908 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784584909.022621:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7c70b2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584909.022634:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784584909.022639:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569032832:0@lo:8:kworker.0 00000100:00080000:2.0:1784584909.022644:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7d0348000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784584909.022648:0:3319:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1784584909.022651:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569032960:0@lo:8:kworker.0 00000100:00080000:2.0:1784584909.022727:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584909.022730:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1784584909.022732:0:38:0:(import.c:65:import_set_state_nolock()) ffff97c7c70b2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584909.022737:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:2.0:1784584909.022742:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784584909.022749:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97c7c70b2000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1784584909.022780:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f1c44a80 x1871272569040128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1784584909.022792:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784584909.022795:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1784584909.022796:0:38:0:(import.c:65:import_set_state_nolock()) ffff97c7d0348000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784584909.022799:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:2.0:1784584909.022802:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1784584909.022804:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97c7d0348000 using connection 192.168.203.152@tcp/0@lo 00000100:00100000:2.0:1784584909.022815:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97c7f1c46a00 x1871272569040256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784584909.022878:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569040128:0@lo:8:kworker.0 00000100:00100000:2.0:1784584909.022933:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584909.022973:0:3319:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569040256:0@lo:8:kworker.0 00000100:00100000:2.0:1784584909.022992:0:3319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584909.023026:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569040128 00000100:00100000:2.0:1784584909.023033:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569040128 00000100:00100000:2.0:1784584909.023056:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569040256 00000100:00100000:2.0:1784584909.023059:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569040256 00000100:00100000:2.0:1784584909.023071:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584909.023078:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3319:x1871272569040128:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784584909.023104:0:14936:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:2.0:1784584909.023130:0:14936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff219f 00002000:00100000:2.0:1784584909.023143:0:14936:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97c6c27d9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784584909.023147:0:14936:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784584909.023149:0:14936:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1784584909.023197:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569040640:0@lo:400:kworker.0 00000100:00100000:1.0:1784584909.023243:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584909.023274:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584909.023282:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569040000:0@lo:400:kworker.0 00000100:00100000:1.0:1784584909.023318:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584909.023352:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569040640 00000100:00100000:1.0:1784584909.023356:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569040640 00000100:00100000:1.0:1784584909.023405:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784584909.023413:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272569040640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584909.023463:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871272569040640:12345-0@lo:400:kworker.0 Request processed in 51us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584909.023478:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784584909.023501:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569040000 00000100:00100000:1.0:1784584909.023505:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569040000 00000100:00100000:1.0:1784584909.023533:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00002000:00080000:2.0:1784584909.023535:0:14936:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1784584909.023541:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+18:3322:x1871272569040000:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1784584909.023560:0:14936:0:(import.c:65:import_set_state_nolock()) ffff97c6c27d8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584909.023574:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+18:3322:x1871272569040000:12345-0@lo:400:kworker.0 Request processed in 35us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584909.023581:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784584909.023610:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1871272569040128:12345-0@lo:8:kworker.0 Request processed in 531us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584909.023618:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584909.023633:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584909.023637:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3319:x1871272569040256:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1784584909.023652:0:14936:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 404 last 0 00000020:00000080:2.0:1784584909.023669:0:14936:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x787d778cc3ff21a6 00002000:00100000:2.0:1784584909.023674:0:14936:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97c6c27dd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136b7 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1784584909.023684:0:14936:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1784584909.023686:0:14936:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:1.0:1784584909.023754:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:2.0:1784584909.023905:0:14936:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1784584909.023918:0:14936:0:(import.c:65:import_set_state_nolock()) ffff97c6c27dd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584909.023947:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1871272569040256:12345-0@lo:8:kworker.0 Request processed in 308us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584909.023953:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1784584909.023986:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7f1c44a80 x1871272569040128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584909.023995:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584909.024002:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1784584909.024008:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784584909.024012:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1784584909.024014:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7c70b2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784584909.024028:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784584909.024032:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569040128:0@lo:8:kworker.0 00010000:00080000:2.0:1784584909.024042:0:3319:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7f1c46a00 x1871272569040256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1784584929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784584909.024049:0:3319:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784584909.024052:0:3319:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1784584909.024056:0:3319:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1784584909.024058:0:3319:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1784584909.024060:0:3319:0:(import.c:65:import_set_state_nolock()) ffff97c7d0348000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1784584909.024069:0:3319:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1784584909.024072:0:3319:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3319:1871272569040256:0@lo:8:kworker.0 00000004:00080000:2.0:1784584909.024108:0:14324:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1784584909.024128:0:14324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1871272569040896:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1784584909.024151:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584909.024163:0:14324:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c6c1d6ad80 going to sleep for 11 seconds 00000004:00080000:2.0:1784584909.024176:0:14325:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1784584909.024517:0:14325:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 404131823938ns, next at 0ns, rc = 0 00000100:00100000:2.0:1784584909.024538:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569040896 00000100:00100000:2.0:1784584909.024542:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569040896 00000100:00100000:2.0:1784584909.024564:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584909.024570:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14324:x1871272569040896:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1784584909.024838:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584909.024873:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569040000:0@lo:400:kworker.0 00010000:00080000:1.0:1784584909.024887:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7f1c47100 x1871272569040640/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584909.024897:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3322:1871272569040640:0@lo:400:kworker.0 00000100:00100000:1.0:1784584909.024914:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584909.024920:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569040768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584909.024959:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584909.027292:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272569040512:0@lo:400:kworker.0 00000100:00100000:0.0:1784584909.027357:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584909.027395:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784584909.027402:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569040384:0@lo:400:kworker.0 00000100:00100000:0.0:1784584909.027428:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584909.027466:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569040512 00000100:00100000:0.0:1784584909.027473:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569040512 00000100:00100000:0.0:1784584909.027519:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569040384 00000100:00100000:0.0:1784584909.027521:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569040384 00000100:00100000:0.0:1784584909.027539:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1784584909.027549:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871272569040512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584909.027558:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784584909.027570:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569040384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584909.027608:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4254000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871272569040512:12345-0@lo:400:kworker.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584909.027616:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1784584909.027634:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4254700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569040384:12345-0@lo:400:kworker.0 Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00080000:0.0:1784584909.027640:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584909.027643:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1784584909.027677:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7f1c45880 x1871272569040384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584909.027713:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569040384:0@lo:400:kworker.0 00010000:00080000:0.0:1784584909.027725:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7f1c44700 x1871272569040512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584925 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784584909.027735:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272569040512:0@lo:400:kworker.0 00000004:00080000:3.0:1784584909.030312:0:14323:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784584909.033836:0:14323:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404141141857ns, next at 0ns, rc = 0 00000004:00080000:3.0:1784584909.033903:0:14326:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1784584909.033926:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1871272569041152:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1784584909.033992:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584909.034017:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784584909.034052:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569041024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584909.034077:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584909.034120:0:14934:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1784584909.034127:0:14934:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1784584909.034154:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569040768 00000100:00100000:3.0:1784584909.034161:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569040768 00000100:00100000:3.0:1784584909.034199:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569041024 00000100:00100000:3.0:1784584909.034202:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569041024 00000100:00100000:3.0:1784584909.034233:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584909.034243:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871272569040768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584909.034274:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584909.034319:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871272569040768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (9359us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584909.034326:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784584909.034346:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784584909.034353:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569041024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784584909.034376:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584909.034416:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2479180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1871272569041024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584909.034424:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1784584909.034469:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c7f1c46a00 x1871272569040768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584909.034489:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569040768:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1784584909.034526:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c6c2478e00 x1871272569041024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1784584925 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784584909.034538:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569041024:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1784584909.034787:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584909.035114:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569041152 00000100:00100000:3.0:1784584909.035120:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569041152 00002000:00080000:2.0:1784584909.035468:0:14936:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1784584909.035476:0:14936:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1784584909.035483:0:14936:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:1.0:1784584909.037201:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784584909.037218:0:15677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14326:x1871272569041152:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784584909.041962:0:15677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1784584909.041974:0:15677:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1784584909.041979:0:15677:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1784584909.057630:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.057643:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.057660:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.057665:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.057672:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.058198:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.058552:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.058574:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.058593:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.058923:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.058930:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.058937:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.058941:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.058950:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.058966:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.058973:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff21ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.058990:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.058992:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.058994:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.061174:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.061195:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.061222:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.061227:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.061234:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.061987:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.062001:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.062008:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.062029:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.062042:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.062047:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.062054:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3a00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.062058:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.062066:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.062318:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.062329:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff21b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.062347:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.062349:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.062350:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.064101:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.064114:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.064128:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.064133:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.064139:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.064152:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.064162:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.064169:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.065330:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584909.066445:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.066456:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.066470:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.066475:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.066480:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.066493:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.066502:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.066511:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784584909.068397:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.068407:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.068420:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.068424:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.068430:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.068443:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.068452:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.068461:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069146:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784584909.069165:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784584909.069173:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069184:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.069196:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069215:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069234:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069247:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069265:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584909.069268:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069275:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.069279:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069286:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069294:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069301:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069316:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.069319:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069326:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.069329:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069336:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069348:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.069356:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.069359:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.069361:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.070005:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.070012:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070022:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.070026:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.070031:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070052:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070061:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070067:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070077:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584909.070475:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584909.070483:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.070505:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2a00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584909.070510:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.070519:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584909.070524:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.070532:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.070536:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070547:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1784584909.070551:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff21d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070553:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.070561:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070572:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.070574:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.070577:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.070581:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.070584:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070616:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070634:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.070644:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.070649:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070656:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.070660:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070668:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070679:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.070687:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff21d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.071060:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.071062:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.071064:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.071928:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.071944:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.071956:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.071960:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.071966:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.071977:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.071987:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.071995:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.072014:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584909.072582:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.072589:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.072599:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.072603:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.072920:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584909.072927:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ae0ea7a/0x787d778cc3ff21c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.073430:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.073444:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.073463:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.073471:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.073481:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:1.0:1784584909.077563:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:1.0:1784584909.077841:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784584909.077860:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.077873:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584909.077877:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.077887:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.077915:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.077923:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb4b9151/0x787d778cc3ff21de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.077944:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584909.077948:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.077955:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2800 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584909.077958:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.077964:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.077987:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.077994:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3c57be5/0x787d778cc3ff21e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.078007:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.078008:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.078010:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.082275:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.084995:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.085011:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085028:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.085033:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.085040:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085055:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085066:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085073:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085173:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.085187:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.085193:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085201:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.085383:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085395:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085412:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085420:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff21ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.085436:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.085437:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.085439:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.085446:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.085452:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085461:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.085464:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.085468:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085478:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085485:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085492:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085518:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584909.085526:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584909.085531:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085537:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801819400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584909.085540:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085547:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085753:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085773:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000738236af/0x787d778cc3ff21f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.085788:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.085789:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.085791:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.086049:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.086055:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.086063:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.086072:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.086077:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.086087:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.086168:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.086175:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.086190:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584909.086328:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.086335:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086343:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.086352:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.086357:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086367:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086374:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086381:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086395:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784584909.086403:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784584909.086407:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086412:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584909.086415:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086423:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086433:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086450:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e0f29c91/0x787d778cc3ff21fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086464:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584909.086468:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.086470:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.086475:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584909.086478:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086486:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086496:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086502:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcb5e02e/0x787d778cc3ff2201 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.086515:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.086516:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.086518:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.087036:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.087043:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.087056:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.087059:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.087064:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584909.087069:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.087074:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087075:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087083:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.087084:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087086:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.087090:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.087092:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.087110:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.087175:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087183:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087195:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087388:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.087393:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087402:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0e200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.087406:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087413:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087425:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087433:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069479583/0x787d778cc3ff2208 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087449:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.087451:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.087452:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.087467:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.087474:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.087483:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087489:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3a00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.087492:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087499:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087508:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087515:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff220f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087526:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.087527:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.087529:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.087639:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.087644:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.087652:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.087748:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.087753:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.087772:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.087791:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.087798:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.087854:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.087871:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.087876:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087884:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0ea00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.087887:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087905:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087917:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087924:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff2216 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.087937:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.087938:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.087940:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.088467:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.088476:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.088484:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.088487:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.088492:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.088502:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584909.088509:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.088510:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.088516:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.088518:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.088525:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.088528:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.088532:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.088541:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.088550:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.088550:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.088562:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.088573:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.088577:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.088584:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0e400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.088588:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.088595:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.088981:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.088990:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff221d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.089007:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.089009:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.089011:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.089023:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.089033:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.089042:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.089050:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.089053:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.089061:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.089072:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.089079:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2224 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.089160:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.089163:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.089165:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.089296:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.089303:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.089312:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.089316:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.089321:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.089331:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.089339:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.089346:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.089368:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584909.092372:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.092387:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092405:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.092410:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.092416:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092444:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092455:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092463:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092488:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784584909.092506:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584909.092512:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092521:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0fe00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.092525:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092535:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092552:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092561:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff222b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092584:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.092588:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092595:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.092598:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092680:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092850:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092859:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2232 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.092874:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.092876:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.092877:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.094001:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.094010:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094021:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.094031:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.094038:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094048:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094057:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094064:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094080:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.094090:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.094162:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094169:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.094173:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094181:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094194:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094391:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff2239 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.094407:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.094409:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.094411:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.095066:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.095074:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.095085:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.095089:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.095166:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.095178:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.095186:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.095193:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.095393:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784584909.097489:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.097502:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.097519:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.097530:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.097538:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.097553:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.097563:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.097571:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.099870:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784584909.100854:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.100865:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.100881:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.100885:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.100891:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.100905:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.100914:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.100929:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.100940:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1784584909.101273:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784584909.101290:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101299:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.101304:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101313:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101332:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101340:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2240 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101361:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584909.101365:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101372:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0e000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.101375:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101382:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101405:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101413:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff2247 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101427:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.101430:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101436:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0ee00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.101439:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101447:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101456:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101463:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff224e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.101474:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.101476:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.101483:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.102449:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.102488:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.102682:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.104409:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.104427:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.104432:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.104438:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.104452:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.104463:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.104471:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.104498:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.104781:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.104788:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.104797:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0f800 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.104801:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.104809:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.104825:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.104832:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b92715c/0x787d778cc3ff2255 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.104848:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.104850:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.104852:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.105160:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.105167:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105194:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.105198:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.105204:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105213:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105220:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105227:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105245:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584909.105255:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584909.105260:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105267:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0f400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584909.105270:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105277:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105299:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105306:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff225c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105318:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.105320:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.105321:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.105824:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.105831:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105841:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.105845:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.105850:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105860:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105867:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105875:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.105906:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.106823:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.106831:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.106841:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0e600 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.106846:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.106870:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.106885:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.106892:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057b69961/0x787d778cc3ff2263 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.106908:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.106910:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.106911:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.107068:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.107074:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107084:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.107087:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.107680:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107776:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107791:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107807:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107826:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.107837:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.107841:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107849:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.107853:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107861:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107874:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107881:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff226a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.107897:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.107899:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.107901:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.108622:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.108630:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.108641:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.108645:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.108650:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.108977:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.108987:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.108995:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.109042:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.109048:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.109059:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109068:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0f000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.109072:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109079:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109679:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784584909.109750:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.109765:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109777:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096271750/0x787d778cc3ff2271 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.109782:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.109791:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.109797:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.109797:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109800:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.109803:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.109807:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.109816:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.109822:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.109842:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.109846:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.109851:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109858:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0ec00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.109862:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109881:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109893:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109900:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ba666210/0x787d778cc3ff2278 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109921:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.109924:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.109927:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.109977:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.109983:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.109991:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.109994:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.109998:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.110007:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.110015:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.110027:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784584909.110225:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.110230:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.110238:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.110241:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.110246:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.110255:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.110261:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.110274:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.110462:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1784584909.111593:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.111602:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.111948:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784584909.112192:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.112196:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.112304:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112319:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112328:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112336:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112350:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584909.112356:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112374:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.112379:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112388:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112403:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112410:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff227f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112426:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.112431:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112437:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0f200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.112440:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112447:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112456:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112469:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004776758b/0x787d778cc3ff2286 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112484:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.112486:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.112488:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.112502:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.112509:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.112513:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112520:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.112523:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112530:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112541:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112548:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff228d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.112558:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.112565:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.112566:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.113075:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.113084:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113093:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.113096:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.113101:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113111:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113119:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113126:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113145:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.113395:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.113400:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.113408:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0f400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.113411:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.113420:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.113433:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.113441:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036a9db8b/0x787d778cc3ff2294 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.113457:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.113460:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.113462:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.113555:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.113562:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113575:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.113579:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.113583:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113592:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113600:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113607:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.113626:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584909.113851:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584909.113858:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.113868:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0fa00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584909.113872:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.113905:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.113923:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.113931:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edf43b87/0x787d778cc3ff229b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.113947:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.113950:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.113952:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.114288:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.114294:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.114303:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.114306:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.114310:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.114320:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.114338:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.114344:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.114348:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.114363:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1784584909.114485:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.114492:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.114501:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.114508:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.114513:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.114523:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.114531:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.114538:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.114551:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784584909.114559:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584909.114563:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.114569:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0e800 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.114573:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.114580:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.114589:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784584909.114907:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.114912:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.114921:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.114923:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.114927:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.114936:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.114943:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.114950:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.114969:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784584909.115181:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff60e901/0x787d778cc3ff22a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115198:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784584909.115203:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115220:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.115224:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115231:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115308:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115316:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22a9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115330:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.115333:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115340:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0fc00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.115348:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115356:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115367:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115373:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa8c325e/0x787d778cc3ff22b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115386:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.115387:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.115390:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.115410:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.115416:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.115424:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.115427:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.115431:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.115440:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.115447:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.115455:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.115475:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.115478:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.115482:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115489:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0f600 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.115493:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115500:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115511:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115523:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad6dd256/0x787d778cc3ff22b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.115536:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.115538:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.115539:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.116127:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.116134:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116143:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.116269:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.116276:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116286:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116294:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116302:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116324:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784584909.116364:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784584909.116370:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.116377:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0ee00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584909.116381:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.116389:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.116401:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.116408:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd820f27/0x787d778cc3ff22be lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.116422:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.116424:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.116425:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.116903:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.116909:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116918:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.116921:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.116924:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116933:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116940:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116954:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116969:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584909.116978:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584909.116982:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.116989:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0e000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584909.116993:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117001:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117011:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117092:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ddfcd13/0x787d778cc3ff22c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117107:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.117108:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.117110:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.117371:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.117377:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.117386:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.117389:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.117394:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.117404:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.117411:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.117418:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.117436:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584909.117440:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584909.117444:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117456:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584909.117460:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117468:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117479:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117486:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c7b7376/0x787d778cc3ff22cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117498:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.117500:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.117501:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.117576:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.117581:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117589:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.117592:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.117596:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117604:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117620:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117627:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.117638:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784584909.117646:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584909.117650:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.117820:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.118316:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0fe00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:1.0:1784584909.118320:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.118328:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.118339:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.118346:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e22776d2/0x787d778cc3ff22d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.118360:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.118367:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.118370:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784584909.119518:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784584909.119529:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.119543:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.119546:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.119553:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.119564:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.119573:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.119580:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.119605:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584909.120411:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584909.120419:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.120441:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0e400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.120446:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.120455:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784584909.120473:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784584909.120475:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.120484:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.120486:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e32f9ec/0x787d778cc3ff22da lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.120505:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784584909.120510:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784584909.120515:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.120517:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.120520:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.120522:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.120535:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.120544:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.120552:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584909.125996:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.126007:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.126024:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.126029:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.126035:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.126062:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.126073:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.126080:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.127402:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584909.127413:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.127424:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0ea00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.127429:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.127438:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.127471:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.127483:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584909.127486:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.127493:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.127496:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.127503:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.127516:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.127523:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.127525:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.127527:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.128379:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1784584909.128388:0:14936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbe95485/0x787d778cc3ff22e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.128508:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.129495:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784584909.129505:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4cffcf6/0x787d778cc3ff22e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584909.130732:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.130742:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.130767:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.130773:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.130781:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.130796:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.130818:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.130825:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.130849:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584909.130859:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584909.130866:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.130874:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.130884:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.130894:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.130910:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.130918:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff22ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.130936:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.130937:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.130939:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584909.131181:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784584909.131189:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.131198:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1784584909.131201:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584909.131205:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.131216:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.131224:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.131388:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.131409:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584909.131442:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584909.131449:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.131457:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.131461:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.131469:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.131483:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.131498:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd468c47/0x787d778cc3ff22f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.131514:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.131516:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.131518:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584909.131939:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784584909.131946:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.131955:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1784584909.131959:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584909.131964:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.131972:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.131980:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.131986:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.132005:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784584909.132429:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584909.132435:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.132445:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.132449:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.132457:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.132468:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.132476:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000438ab1d7/0x787d778cc3ff22fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.132491:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.132492:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.132494:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.133040:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.133049:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.133059:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.133062:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.133067:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.133077:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.133086:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.133163:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.133193:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784584909.133272:0:15677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784584909.133279:0:15677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.133293:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=404s v=(0 0) 00010000:00010000:0.0:1784584909.133297:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584909.133302:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.133312:0:15677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.133320:0:15677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.133328:0:15677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.133347:0:15677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784584909.133355:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784584909.133362:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133370:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.133374:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133381:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133393:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133400:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e54b305/0x787d778cc3ff2304 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133415:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584909.133418:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133425:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bea00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.133428:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133435:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133458:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133465:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cce8086/0x787d778cc3ff230b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.133480:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.133482:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.133484:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584909.133946:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784584909.134527:0:15677:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1784584909.134623:0:15677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2479880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14326:x1871272569041152:12345-0@lo:5:osp-pre-1-0.0 Request processed in 97407us (100627us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584909.134637:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784584909.134867:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1871272569041152:0@lo:5:osp-pre-1-0.0 00002000:00010000:2.0:1784584909.134869:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.134876:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784584909.134883:0:14326:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00010000:00010000:2.0:1784584909.134888:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.134892:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.134897:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.134907:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.134915:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.134921:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584909.134923:0:14326:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1871272569041280:0@lo:5:osp-pre-1-0.0 00010000:00010000:2.0:1784584909.134941:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784584909.134956:0:14326:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584909.134998:0:14326:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c3906480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584909.135136:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569041280 00000100:00100000:1.0:1784584909.135142:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569041280 00000100:00100000:1.0:1784584909.135183:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784584909.135191:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14326:x1871272569041280:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1784584909.135225:0:14934:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:3.0:1784584909.135809:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584909.135816:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.135825:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.135829:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.135837:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584909.135996:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.136003:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.136012:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.136021:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.136026:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.136038:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.136046:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.136052:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.136070:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584909.136095:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1784584909.137513:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784584909.137806:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.137817:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff2312 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.137861:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.137863:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.137865:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784584909.138186:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.138197:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.138200:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.138216:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.138227:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.138236:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.138257:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.138280:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584909.138337:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584909.138345:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.138355:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584909.138360:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.138378:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.138391:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.138398:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdee900f/0x787d778cc3ff2320 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.138419:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.138422:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.138425:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1784584909.138982:0:14936:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784584909.138989:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.138998:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784584909.139001:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584909.139006:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.139016:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.139024:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.139031:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584909.139047:0:14936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784584909.139325:0:14289:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584909.139331:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.139339:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584909.139342:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.139351:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.139363:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.139382:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5fe1621/0x787d778cc3ff2327 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.139399:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.139401:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584909.139404:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1784584909.139679:0:14936:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1784584909.139798:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14324:x1871272569040896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 115225us (115643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584909.139814:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784584909.143528:0:14324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1871272569040896:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784584909.143546:0:14324:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1784584909.143597:0:14324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1871272569041408:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1784584909.143663:0:14324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584909.143711:0:14324:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c720a180 going to sleep for 11 seconds 00000100:00100000:0.0:1784584909.143727:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569041408 00000100:00100000:0.0:1784584909.143732:0:15677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569041408 00000100:00100000:0.0:1784584909.143787:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584909.143797:0:15677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14324:x1871272569041408:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1784584909.143844:0:15677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1784584909.145530:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14326:x1871272569041280:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10332us (10565us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784584909.145542:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1784584909.146000:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1784584909.146580:0:14326:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14326:1871272569041280:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1784584909.146595:0:14326:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1784584909.146716:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.146726:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.146738:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3a00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584909.146743:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.146755:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.146787:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.146797:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f95951d/0x787d778cc3ff2319 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.146820:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.146823:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.146827:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.146845:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584909.146849:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584909.161710:0:15677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14324:x1871272569041408:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17893us (18025us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784584909.161724:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584909.167486:0:14324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14324:1871272569041408:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1784584909.167505:0:14324:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 10000000:01000000:1.0:1784584909.479125:0:14298:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784584909.479133:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff97c7f428a800 from 8 10000000:01000000:1.0:1784584909.479138:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784584909.479282:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e200/0x787d778cc3ff232e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.479295:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e200/0x787d778cc3ff232e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584909.479306:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e200/0x787d778cc3ff232e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584909.479391:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569041536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584909.479457:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584909.479675:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c3906540 going to sleep for 11 seconds 00000100:00100000:0.0:1784584909.483900:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569041536 00000100:00100000:0.0:1784584909.483916:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569041536 00000100:00100000:3.0:1784584909.484392:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1784584909.484408:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+18:14298:x1871272569041536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584909.484425:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584909.484443:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff232e expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.484470:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff232e expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.484480:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaedc00/0x787d778cc3ff2335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff232e expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.484488:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaedc00, rc 0) 00000100:00100000:3.0:1784584909.484578:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:14298:x1871272569041536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584909.484584:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784584909.484858:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569041536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584909.484878:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e200/0x787d778cc3ff232e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2335 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.484907:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e200/0x787d778cc3ff232e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff2335 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584909.484971:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569041664:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784584909.485011:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584909.485044:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c720af00 going to sleep for 11 seconds 00000100:00100000:3.0:1784584909.485716:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569041664 00000100:00100000:3.0:1784584909.485724:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569041664 00000100:00100000:2.0:1784584909.487203:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784584909.487215:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:14298:x1871272569041664:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1784584909.487239:0:14296:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1784584909.487257:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1784584909.487260:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1784584909.490007:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:14298:x1871272569041664:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2786us (4985us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584909.490021:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1784584909.490652:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4254a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569041664:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784584909.490991:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784584909.491002:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e200/0x787d778cc3ff232e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2335 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584909.491013:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e200/0x787d778cc3ff232e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff2335 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584909.919153:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784584910.450593:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1784584910.450654:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1784584910.940990:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584911.975491:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584912.988930:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784584913.549582:0:7511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1784584913.549637:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:3.0:1784584913.926661:0:15960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg352-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784584914.022420:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584914.459902:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784584914.459924:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c2478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569041792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584914.459992:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584914.460057:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569041792 00000100:00100000:3.0:1784584914.460064:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569041792 00000100:00100000:3.0:1784584914.460115:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584914.460123:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569041792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784584914.460169:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584914.460216:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2479f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569041792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584914.460223:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784584914.460259:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1784584914.460281:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c2478e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569041792:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1784584914.460414:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784584914.460504:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f1c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569041920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584914.460533:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584914.460613:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569041920 00000100:00100000:2.0:1784584914.460618:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569041920 00000100:00100000:2.0:1784584914.460656:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584914.460663:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569041920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584914.460683:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584914.460755:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2478e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569041920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584914.460762:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584914.460788:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1784584914.460801:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f1c44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569041920:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1784584914.460873:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584914.461748:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272569042304:0@lo:400:kworker.0 00000100:00100000:1.0:1784584914.461791:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584914.461809:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:978ed13c-6d08-4d66-8bb5-98db460a5248:3323:1871272569042048:0@lo:400:kworker.0 00000100:00100000:1.0:1784584914.461815:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784584914.461833:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569042176:0@lo:400:kworker.0 00000100:00100000:3.0:1784584914.461841:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584914.461855:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584914.461866:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584914.461871:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569042432:0@lo:400:kworker.0 00000100:00100000:3.0:1784584914.461897:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584914.461898:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569042304 00000100:00100000:1.0:1784584914.461903:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569042304 00000100:00100000:3.0:1784584914.461920:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569042048 00000100:00100000:3.0:1784584914.461924:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569042048 00000100:00100000:1.0:1784584914.461938:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569042176 00000100:00100000:1.0:1784584914.461940:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569042176 00000100:00100000:1.0:1784584914.461950:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569042432 00000100:00100000:1.0:1784584914.461952:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569042432 00000100:00100000:3.0:1784584914.461953:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784584914.461958:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3323:x1871272569042048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584914.461964:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784584914.461969:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871272569042304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584914.461995:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3323:x1871272569042048:12345-0@lo:400:kworker.0 Request processed in 36us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584914.461996:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871272569042304:12345-0@lo:400:kworker.0 Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584914.462003:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784584914.462003:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784584914.462016:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784584914.462020:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569042176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584914.462043:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:978ed13c-6d08-4d66-8bb5-98db460a5248:3323:1871272569042048:0@lo:400:kworker.0 00000100:00100000:1.0:1784584914.462043:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871272569042176:12345-0@lo:400:kworker.0 Request processed in 23us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584914.462063:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784584914.462074:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784584914.462080:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569042432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584914.462115:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569042432:12345-0@lo:400:kworker.0 Request processed in 35us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584914.462121:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1784584914.462136:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8010bd880 x1871272569042432/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784584914.462138:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584914.462159:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569042432:0@lo:400:kworker.0 00010000:00080000:1.0:1784584914.463522:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8010bf480 x1871272569042176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584914.463536:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871272569042176:0@lo:400:kworker.0 00010000:00080000:1.0:1784584914.463564:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97c8010bfb80 x1871272569042304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1784584930 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784584914.463574:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c8010bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3321:1871272569042304:0@lo:400:kworker.0 00010000:00010000:0.0:1784584915.042851:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784584915.489065:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784584916.061009:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584916.084540:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584916.084742:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549129472 00000100:00100000:2.0:1784584916.084752:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549129472 00000100:00100000:2.0:1784584916.084800:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:2.0:1784584916.084808:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2353:x1871272549129472:12345-192.168.203.52@tcp:250:mount.lustre.0 00010000:00080000:2.0:1784584916.084834:0:14296:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from e9b2828d-82a9-4744-ba1c-9b5761f53fea@192.168.203.52@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:2.0:1784584916.084877:0:14296:0:(genops.c:1406:class_connect()) connect: client e9b2828d-82a9-4744-ba1c-9b5761f53fea, cookie 0x787d778cc3ff233c 00000100:00080000:2.0:1784584916.085011:0:14296:0:(import.c:65:import_set_state_nolock()) ffff97c6c27d9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584916.085096:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+5:2353:x1871272549129472:12345-192.168.203.52@tcp:250:mount.lustre.0 Request processed in 287us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584916.085104:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 75 00000100:00100000:2.0:1784584916.100487:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584916.100635:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549129600 00000100:00100000:3.0:1784584916.100644:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549129600 00000100:00100000:3.0:1784584916.100734:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:3.0:1784584916.100744:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+5:13706:x1871272549129600:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784584916.100759:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584916.100776:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaeca00/0x787d778cc3ff2343 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb31e3 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584916.100803:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaeca00/0x787d778cc3ff2343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31e3 expref: 6 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584916.100813:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaeca00/0x787d778cc3ff2343 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31e3 expref: 6 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584916.100822:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaeca00, rc 0) 00000100:00100000:3.0:1784584916.100869:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f569bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+6:13706:x1871272549129600:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 128us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.100889:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 76 00000100:00100000:1.0:1784584916.105212:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584916.110530:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549129728 00000100:00100000:3.0:1784584916.110544:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549129728 00000100:00100000:3.0:1784584916.111545:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:3.0:1784584916.111678:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+6:13706:x1871272549129728:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584916.113150:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+6:13706:x1871272549129728:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 1589us (7938us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784584916.113169:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 77 00000100:00100000:0.0:1784584916.120883:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584916.120973:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549129856 00000100:00100000:2.0:1784584916.120984:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549129856 00000100:00100000:2.0:1784584916.121155:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1784584916.121167:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+6:13706:x1871272549129856:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784584916.121185:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584916.121203:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c7fa3000/0x787d778cc3ff234a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb31ea expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584916.121424:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c7fa3000/0x787d778cc3ff234a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ea expref: 7 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584916.121437:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c7fa3000/0x787d778cc3ff234a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb31ea expref: 7 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584916.121446:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3000, rc 0) 00000100:00100000:2.0:1784584916.121502:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+7:13706:x1871272549129856:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 338us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584916.121509:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 78 00000100:00100000:2.0:1784584916.125218:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584916.125666:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549129984 00000100:00100000:3.0:1784584916.125676:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549129984 00000100:00100000:3.0:1784584916.125771:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:3.0:1784584916.125781:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+7:13706:x1871272549129984:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584916.126083:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+8:13706:x1871272549129984:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 302us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.126092:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 79 00000100:00100000:1.0:1784584916.146223:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584916.152301:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549130112 00000100:00100000:2.0:1784584916.152376:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549130112 00000100:00100000:2.0:1784584916.152525:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1784584916.152553:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+8:13706:x1871272549130112:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784584916.152973:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+8:13706:x1871272549130112:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 422us (6756us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584916.152982:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 80 00000100:00100000:2.0:1784584916.168122:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584916.168215:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549130240 00000100:00100000:0.0:1784584916.168225:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549130240 00000100:00100000:0.0:1784584916.168274:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1784584916.168284:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+8:13724:x1871272549130240:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584916.168755:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+8:13724:x1871272549130240:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 471us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584916.168762:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 81 00000100:00100000:0.0:1784584916.201832:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584916.202955:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549130368 00000100:00100000:2.0:1784584916.202967:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549130368 00000100:00100000:3.0:1784584916.203507:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:3.0:1784584916.203528:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+8:13724:x1871272549130368:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584916.203849:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+8:13724:x1871272549130368:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 332us (2025us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.203857:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 82 00000100:00100000:1.0:1784584916.218799:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584916.221332:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549130496 00000100:00100000:0.0:1784584916.221350:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549130496 00000100:00100000:0.0:1784584916.221559:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:0.0:1784584916.221572:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f5699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+8:13706:x1871272549130496:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784584916.221601:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584916.221625:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3214 expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584916.221682:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3214 expref: 9 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584916.221745:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf200/0x787d778cc3ff2351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3214 expref: 9 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584916.221758:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf200, rc 0) 00000100:00100000:0.0:1784584916.221844:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f5699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+9:13706:x1871272549130496:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 275us (3130us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584916.221851:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 83 00000100:00100000:2.0:1784584916.229672:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584916.230181:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549130624 00000100:00100000:3.0:1784584916.230192:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549130624 00000100:00100000:3.0:1784584916.230259:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:3.0:1784584916.230269:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+9:13706:x1871272549130624:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784584916.230310:0:14296:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784584916.230328:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784584916.230332:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784584916.230335:0:14296:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784584916.230337:0:14296:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1784584916.235054:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+9:13706:x1871272549130624:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 4761us (5366us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.235068:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 84 00000100:00100000:1.0:1784584916.241562:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584916.241743:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549130752 00000100:00100000:0.0:1784584916.241758:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549130752 00000100:00100000:0.0:1784584916.241822:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:0.0:1784584916.241833:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+9:13706:x1871272549130752:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784584916.241852:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584916.241874:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb321b expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584916.241907:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb321b expref: 10 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584916.241919:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb321b expref: 10 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584916.241935:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf600, rc 0) 00000100:00100000:0.0:1784584916.242016:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13706:x1871272549130752:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 184us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584916.242151:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 85 00000100:00100000:2.0:1784584916.262513:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584916.262605:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549130880 00000100:00100000:3.0:1784584916.262615:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549130880 00000100:00100000:3.0:1784584916.262752:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:3.0:1784584916.262763:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13706:x1871272549130880:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584916.263053:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13706:x1871272549130880:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 286us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.263061:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 86 00000100:00100000:2.0:1784584916.270894:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584916.271539:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549131008 00000100:00100000:0.0:1784584916.271549:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549131008 00000100:00100000:0.0:1784584916.271635:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:0.0:1784584916.271644:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13706:x1871272549131008:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:0.0:1784584916.272037:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13706:x1871272549131008:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 386us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584916.272051:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 87 00000100:00100000:1.0:1784584916.281408:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584916.281493:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549131136 00000100:00100000:3.0:1784584916.281502:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549131136 00000100:00100000:3.0:1784584916.281591:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:3.0:1784584916.281601:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13728:x1871272549131136:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584916.281992:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13728:x1871272549131136:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 391us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.282001:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 88 00000100:00100000:2.0:1784584916.294364:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584916.295922:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549131264 00000100:00100000:0.0:1784584916.295935:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549131264 00000100:00100000:0.0:1784584916.295990:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:0.0:1784584916.296000:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13728:x1871272549131264:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784584916.297724:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13728:x1871272549131264:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 1690us (3334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584916.297739:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 89 00000100:00100000:3.0:1784584916.314400:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584916.314593:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549131392 00000100:00100000:2.0:1784584916.314612:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549131392 00000100:00100000:2.0:1784584916.314661:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1784584916.314669:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2353:x1871272549131392:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784584916.314742:0:14303:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from ef0695b2-b73d-4d2d-9d3e-86d6851e1509@192.168.203.52@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:2.0:1784584916.314798:0:14303:0:(genops.c:1406:class_connect()) connect: client ef0695b2-b73d-4d2d-9d3e-86d6851e1509, cookie 0x787d778cc3ff235f 00000004:00100000:2.0:1784584916.314835:0:14303:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1784584916.314841:0:14303:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1784584916.408100:0:14303:0:(import.c:65:import_set_state_nolock()) ffff97c6c27dc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784584916.408187:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2353:x1871272549131392:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 93515us (93795us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584916.408198:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1784584916.411590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584916.411681:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549131520 00000100:00100000:2.0:1784584916.411738:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549131520 00000100:00100000:2.0:1784584916.411800:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1784584916.411810:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:0:x1871272549131520:12345-192.168.203.52@tcp:41:mount.lustre.0 00000100:00100000:3.0:1784584916.411836:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584916.411862:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549131648 00000100:00100000:3.0:1784584916.411866:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549131648 00000100:00100000:3.0:1784584916.411903:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1784584916.411911:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:13706:x1871272549131648:12345-192.168.203.52@tcp:41:mount.lustre.0 00000100:00080000:1.0:1784584916.411934:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1784584916.412004:0:15235:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000004:00000024:3.0:1784584916.412013:0:14302:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784584916.412094:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:13706:x1871272549131648:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 184us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.412102:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1784584916.416888:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:0:x1871272549131520:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 5068us (5295us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.416903:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1784584916.417534:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584916.417725:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549131776 00000100:00100000:0.0:1784584916.417735:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549131776 00000100:00100000:0.0:1784584916.417786:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1784584916.417796:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:13706:x1871272549131776:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784584916.417873:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:13706:x1871272549131776:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 78us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584916.417880:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1784584916.425131:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584916.425169:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584916.425331:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549132160 00000100:00100000:3.0:1784584916.425339:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549132160 00000100:00100000:3.0:1784584916.425391:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1784584916.425400:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:13706:x1871272549132160:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00080000:3.0:1784584916.425992:0:14304:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 520us 00000100:00100000:0.0:1784584916.428949:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584916.441725:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549131904 00000100:00100000:2.0:1784584916.441740:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549131904 00000100:00100000:0.0:1784584916.442313:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549132032 00000100:00100000:0.0:1784584916.442331:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549132032 00000100:00100000:0.0:1784584916.442356:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1784584916.442365:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1871272549131904:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784584916.442397:0:14934:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from ef0695b2-b73d-4d2d-9d3e-86d6851e1509@192.168.203.52@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:0.0:1784584916.442429:0:14934:0:(genops.c:1406:class_connect()) connect: client ef0695b2-b73d-4d2d-9d3e-86d6851e1509, cookie 0x787d778cc3ff2366 00002000:00100000:0.0:1784584916.442441:0:14934:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ef0695b2-b73d-4d2d-9d3e-86d6851e1509/ffff97c7feb37000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784584916.442464:0:14934:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784584916.442792:0:14934:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1784584916.442834:0:14934:0:(import.c:65:import_set_state_nolock()) ffff97c7feb36800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584916.442910:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2353:x1871272549131904:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 544us (17739us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584916.442917:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:0.0:1784584916.442934:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:0.0:1784584916.442939:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2353:x1871272549132032:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:0.0:1784584916.442956:0:14934:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from ef0695b2-b73d-4d2d-9d3e-86d6851e1509@192.168.203.52@tcp t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:0.0:1784584916.442973:0:14934:0:(genops.c:1406:class_connect()) connect: client ef0695b2-b73d-4d2d-9d3e-86d6851e1509, cookie 0x787d778cc3ff236d 00002000:00100000:0.0:1784584916.442979:0:14934:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ef0695b2-b73d-4d2d-9d3e-86d6851e1509/ffff97c7feb34000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784584916.442992:0:14934:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784584916.443179:0:14934:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784584916.443195:0:14934:0:(import.c:65:import_set_state_nolock()) ffff97c7feb35000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784584916.443233:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4256a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2353:x1871272549132032:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 292us (14292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584916.443240:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000004:00200000:3.0:1784584916.454903:0:14304:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1784584916.455077:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:13706:x1871272549132160:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 29672us (29950us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.455089:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1784584916.661097:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584916.661185:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549132288 00000100:00100000:3.0:1784584916.661195:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549132288 00000100:00100000:3.0:1784584916.661270:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1784584916.661281:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:13749:x1871272549132288:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:3.0:1784584916.661305:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584916.661333:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec800/0x787d778cc3ff2374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3245 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584916.661414:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec200/0x787d778cc3ff237b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584916.661429:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec200/0x787d778cc3ff237b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584916.661442:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec200/0x787d778cc3ff237b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584916.661638:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784584916.661643:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584916.661813:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec200/0x787d778cc3ff237b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584916.661855:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec800/0x787d778cc3ff2374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3245 expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584916.661873:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec200/0x787d778cc3ff237b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3245 expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584916.661882:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c200) 00010000:00010000:3.0:1784584916.661885:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584916.661889:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec200, rc 0) 00000100:00100000:3.0:1784584916.661957:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:13749:x1871272549132288:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 678us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584916.661965:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00010000:00010000:3.0:1784584917.085403:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584918.107986:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1784584918.651020:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef0695b2-b73d-4d2d-9d3e-86d6851e1509 00000100:00100000:0.0:1784584918.695517:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584918.695666:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549132416 00000100:00100000:2.0:1784584918.695677:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549132416 00000100:00100000:2.0:1784584918.695806:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1784584918.695818:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:13801:x1871272549132416:12345-192.168.203.52@tcp:41:lfs.0 00000004:00000024:2.0:1784584918.695870:0:14301:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784584918.695951:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4257100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:13801:x1871272549132416:12345-192.168.203.52@tcp:41:lfs.0 Request processed in 135us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584918.695959:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:1.0:1784584918.696169:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584918.702910:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584918.706466:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549132544 00000100:00100000:3.0:1784584918.706500:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549132544 00000100:00100000:2.0:1784584918.706823:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1784584918.706834:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:13801:x1871272549132544:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:2.0:1784584918.706992:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584918.707086:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:13801:x1871272549132544:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 253us (4185us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584918.707093:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00080000:1.0:1784584918.710508:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584918.717032:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584918.717120:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549132672 00000100:00100000:3.0:1784584918.717130:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549132672 00000100:00100000:3.0:1784584918.717200:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1784584918.717211:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:13801:x1871272549132672:12345-192.168.203.52@tcp:13:lfs.0 00002000:00000024:3.0:1784584918.717259:0:14938:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584918.717347:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:13801:x1871272549132672:12345-192.168.203.52@tcp:13:lfs.0 Request processed in 138us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584918.717355:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00080000:1.0:1784584918.718185:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584918.912196:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584918.912499:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549132800 00000100:00100000:3.0:1784584918.912509:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549132800 00000100:00100000:3.0:1784584918.912569:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:3.0:1784584918.912579:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+10:13832:x1871272549132800:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784584918.912595:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584918.912612:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaec800/0x787d778cc3ff2382 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb324c expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584918.912640:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaec800/0x787d778cc3ff2382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb324c expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584918.912651:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaec800/0x787d778cc3ff2382 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb324c expref: 11 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584918.912660:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec800, rc 0) 00000100:00100000:3.0:1784584918.912753:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13832:x1871272549132800:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 175us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584918.912760:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 90 00000100:00100000:0.0:1784584918.935371:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584918.935522:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549132928 00000100:00100000:3.0:1784584918.935545:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549132928 00000100:00100000:3.0:1784584918.935606:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:3.0:1784584918.935616:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13832:x1871272549132928:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584918.935965:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13832:x1871272549132928:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 349us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584918.935974:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 91 00000100:00100000:0.0:1784584918.944815:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584918.945055:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549133056 00000100:00100000:1.0:1784584918.945066:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549133056 00000100:00100000:1.0:1784584918.945124:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:1.0:1784584918.945134:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13832:x1871272549133056:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784584918.945590:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13832:x1871272549133056:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 455us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584918.945598:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 92 00000100:00100000:0.0:1784584918.962976:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584918.963122:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549133184 00000100:00100000:1.0:1784584918.963132:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549133184 00000100:00100000:1.0:1784584918.963213:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:1.0:1784584918.963223:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f3c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13840:x1871272549133184:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784584918.963673:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f3c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13840:x1871272549133184:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 450us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584918.963683:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 93 00000100:00100000:0.0:1784584918.978345:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584918.978517:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549133312 00000100:00100000:3.0:1784584918.978528:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549133312 00000100:00100000:3.0:1784584918.978590:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:3.0:1784584918.978600:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13840:x1871272549133312:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584918.979076:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13840:x1871272549133312:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 475us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584918.979085:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 94 00000100:00100000:0.0:1784584918.982951:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584918.985499:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549133440 00000100:00100000:1.0:1784584918.985514:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549133440 00000100:00100000:1.0:1784584918.985579:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:1.0:1784584918.985589:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13832:x1871272549133440:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784584918.985607:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584918.985626:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7feb0f800/0x787d778cc3ff2389 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3276 expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584918.985655:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7feb0f800/0x787d778cc3ff2389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3276 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584918.985666:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7feb0f800/0x787d778cc3ff2389 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3276 expref: 12 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584918.985675:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7feb0f800, rc 0) 00000100:00100000:1.0:1784584918.985785:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13832:x1871272549133440:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 197us (2844us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584918.985792:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 95 00000100:00100000:2.0:1784584918.997026:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584918.997107:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549133568 00000100:00100000:3.0:1784584918.997116:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549133568 00000100:00100000:3.0:1784584918.997182:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:3.0:1784584918.997194:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13832:x1871272549133568:12345-192.168.203.52@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784584918.997219:0:14293:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784584918.997251:0:14293:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784584918.997256:0:14293:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784584918.997259:0:14293:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784584918.997261:0:14293:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1784584919.002521:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13832:x1871272549133568:12345-192.168.203.52@tcp:256:mount.lustre.0 Request processed in 5319us (5495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.002537:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 96 00000100:00100000:2.0:1784584919.008676:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584919.008802:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549133696 00000100:00100000:3.0:1784584919.008826:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549133696 00000100:00100000:3.0:1784584919.008888:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:3.0:1784584919.008898:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13832:x1871272549133696:12345-192.168.203.52@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784584919.008916:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584919.008935:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb327d expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584919.008963:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb327d expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584919.008974:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb327d expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584919.008983:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaecc00, rc 0) 00000100:00100000:3.0:1784584919.009046:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13832:x1871272549133696:12345-192.168.203.52@tcp:101:mount.lustre.0 Request processed in 149us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.009053:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 97 00000100:00100000:2.0:1784584919.011535:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584919.011669:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549133824 00000100:00100000:3.0:1784584919.011678:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549133824 00000100:00100000:3.0:1784584919.011820:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:3.0:1784584919.011831:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13832:x1871272549133824:12345-192.168.203.52@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784584919.012134:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13832:x1871272549133824:12345-192.168.203.52@tcp:501:mount.lustre.0 Request processed in 303us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.012151:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 98 00000100:00100000:0.0:1784584919.015210:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584919.015550:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549133952 00000100:00100000:1.0:1784584919.015559:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549133952 00000100:00100000:1.0:1784584919.015641:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:1.0:1784584919.015650:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13832:x1871272549133952:12345-192.168.203.52@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784584919.015901:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13832:x1871272549133952:12345-192.168.203.52@tcp:503:mount.lustre.0 Request processed in 251us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584919.015909:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 99 00000100:00100000:2.0:1784584919.019208:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584919.020086:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549134080 00000100:00100000:3.0:1784584919.020098:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549134080 00000100:00100000:3.0:1784584919.020217:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:3.0:1784584919.020235:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13845:x1871272549134080:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584919.020521:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13845:x1871272549134080:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 287us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.020530:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 100 00000100:00100000:2.0:1784584919.035595:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584919.035829:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549134208 00000100:00100000:3.0:1784584919.035841:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549134208 00000100:00100000:3.0:1784584919.035921:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:3.0:1784584919.035934:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13845:x1871272549134208:12345-192.168.203.52@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784584919.036447:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13845:x1871272549134208:12345-192.168.203.52@tcp:502:llog_process_th.0 Request processed in 514us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.036456:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 101 00000100:00100000:2.0:1784584919.042353:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584919.042402:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584919.042450:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584919.042573:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584919.042622:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549134848 00000100:00100000:2.0:1784584919.042635:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549134848 00000100:00100000:2.0:1784584919.042749:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549134976 00000100:00100000:2.0:1784584919.042753:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549134976 00000100:00100000:0.0:1784584919.042780:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1784584919.042867:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549134336 00000100:00100000:1.0:1784584919.042872:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549134336 00000100:00100000:1.0:1784584919.042899:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549134720 00000100:00100000:1.0:1784584919.042902:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549134720 00000100:00100000:1.0:1784584919.042929:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1784584919.042939:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2356:x1871272549134720:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584919.043035:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2356:x1871272549134720:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 97us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584919.043045:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:1.0:1784584919.043064:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1784584919.043069:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2353:x1871272549134336:12345-192.168.203.52@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784584919.043095:0:15235:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 1721672f-5c01-4877-84ad-d16d0b74ee5d@192.168.203.52@tcp t0 exp 0000000000000000 cur 414 last 0 00000100:00100000:0.0:1784584919.043115:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2356:x1871272549134848:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584919.043200:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2356:x1871272549134848:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 395us (797us total) trans 0 rc 0/0 00000020:00000080:1.0:1784584919.043450:0:15235:0:(genops.c:1406:class_connect()) connect: client 1721672f-5c01-4877-84ad-d16d0b74ee5d, cookie 0x787d778cc3ff2397 00000004:00100000:1.0:1784584919.043493:0:15235:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1784584919.043637:0:15235:0:(import.c:65:import_set_state_nolock()) ffff97c6c2775000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584919.043678:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2353:x1871272549134336:12345-192.168.203.52@tcp:38:mount.lustre.0 Request processed in 607us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584919.043686:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1784584919.044004:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:2.0:1784584919.044017:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f1c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2356:x1871272549134976:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584919.044054:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f1c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2356:x1871272549134976:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 43us (1481us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584919.044061:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1784584919.048010:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1784584919.051471:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584919.051520:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584919.051609:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549134592 00000100:00100000:3.0:1784584919.051621:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549134592 00000100:00080000:2.0:1784584919.051777:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584919.051839:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549134464 00000100:00100000:3.0:1784584919.051843:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549134464 00000100:00100000:3.0:1784584919.051988:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1784584919.052001:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+7:13832:x1871272549134592:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784584919.052060:0:14302:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784584919.052168:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+7:13832:x1871272549134592:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 162us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.052177:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1784584919.052196:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1784584919.052204:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:0:x1871272549134464:12345-192.168.203.52@tcp:41:mount.lustre.0 00000004:00000024:3.0:1784584919.052215:0:14302:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784584919.052249:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:0:x1871272549134464:12345-192.168.203.52@tcp:41:mount.lustre.0 Request processed in 45us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.052274:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:1.0:1784584919.065561:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584919.065727:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549135104 00000100:00100000:0.0:1784584919.065740:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549135104 00000100:00100000:0.0:1784584919.065806:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:0.0:1784584919.065818:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:13832:x1871272549135104:12345-192.168.203.52@tcp:40:mount.lustre.0 00000100:00100000:0.0:1784584919.065990:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:13832:x1871272549135104:12345-192.168.203.52@tcp:40:mount.lustre.0 Request processed in 174us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584919.065999:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1784584919.075624:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584919.075668:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584919.075789:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584919.081474:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549135488 00000100:00100000:0.0:1784584919.081495:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549135488 00000100:00100000:0.0:1784584919.081587:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1784584919.081599:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:13832:x1871272549135488:12345-192.168.203.52@tcp:33:mount.lustre.0 00000004:00200000:0.0:1784584919.082030:0:14305:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1784584919.082387:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2478a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:13832:x1871272549135488:12345-192.168.203.52@tcp:33:mount.lustre.0 Request processed in 786us (6774us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584919.082397:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:1.0:1784584919.084141:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549135232 00000100:00100000:1.0:1784584919.084157:0:15677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549135232 00000100:00100000:1.0:1784584919.084261:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549135360 00000100:00100000:1.0:1784584919.084281:0:15677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549135360 00000100:00100000:1.0:1784584919.084317:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1784584919.084326:0:15677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1871272549135232:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784584919.084366:0:15677:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 1721672f-5c01-4877-84ad-d16d0b74ee5d@192.168.203.52@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:1.0:1784584919.084404:0:15677:0:(genops.c:1406:class_connect()) connect: client 1721672f-5c01-4877-84ad-d16d0b74ee5d, cookie 0x787d778cc3ff239e 00002000:00100000:1.0:1784584919.084420:0:15677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1721672f-5c01-4877-84ad-d16d0b74ee5d/ffff97c6c2776800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784584919.084434:0:15677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784584919.084574:0:15677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784584919.084620:0:15677:0:(import.c:65:import_set_state_nolock()) ffff97c6c2777000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584919.084751:0:15677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2353:x1871272549135232:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 423us (9080us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584919.084759:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:1.0:1784584919.084777:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:1.0:1784584919.084781:0:15677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2353:x1871272549135360:12345-192.168.203.52@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784584919.084797:0:15677:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 1721672f-5c01-4877-84ad-d16d0b74ee5d@192.168.203.52@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:1.0:1784584919.084816:0:15677:0:(genops.c:1406:class_connect()) connect: client 1721672f-5c01-4877-84ad-d16d0b74ee5d, cookie 0x787d778cc3ff23a5 00002000:00100000:1.0:1784584919.084822:0:15677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1721672f-5c01-4877-84ad-d16d0b74ee5d/ffff97c6c2772000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136b7 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784584919.084828:0:15677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784584919.085042:0:15677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784584919.085059:0:15677:0:(import.c:65:import_set_state_nolock()) ffff97c6c2771800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784584919.085086:0:15677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2478000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2353:x1871272549135360:12345-192.168.203.52@tcp:8:mount.lustre.0 Request processed in 303us (9297us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584919.085094:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00010000:00010000:3.0:1784584919.132328:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584919.221254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584919.221622:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549135616 00000100:00100000:1.0:1784584919.221895:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549135616 00000100:00100000:0.0:1784584919.222148:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1784584919.222170:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:13866:x1871272549135616:12345-192.168.203.52@tcp:101:mkdir.0 00010000:00010000:0.0:1784584919.222197:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584919.222426:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff23ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32a7 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584919.222913:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584919.222932:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584919.222947:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584919.224426:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784584919.224437:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584919.224606:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584919.224654:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff23ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32a7 expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584919.224677:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32a7 expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584919.224688:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c200) 00010000:00010000:0.0:1784584919.224746:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584919.224751:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfa00, rc 0) 00000100:00100000:0.0:1784584919.224837:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+7:13866:x1871272549135616:12345-192.168.203.52@tcp:101:mkdir.0 Request processed in 2676us (3604us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584919.224846:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1784584919.580083:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:978ed13c-6d08-4d66-8bb5-98db460a5248:3323:1871272569042560:0@lo:400:kworker.0 00000100:00100000:1.0:1784584919.580099:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569042944:0@lo:400:kworker.0 00000100:00100000:0.0:1784584919.580626:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569042688:0@lo:400:kworker.0 00000100:00100000:2.0:1784584919.580737:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569042816:0@lo:400:kworker.0 00000100:00100000:1.0:1784584919.590455:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584919.590564:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569043456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584919.590610:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584919.590727:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569043456 00000100:00100000:3.0:1784584919.590800:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584919.590836:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272569043072:0@lo:400:kworker.0 00000100:00100000:3.0:1784584919.590865:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584919.590902:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569042560 00000100:00100000:3.0:1784584919.590906:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569042560 00000100:00100000:3.0:1784584919.590974:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784584919.590986:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3323:x1871272569042560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584919.591053:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3323:x1871272569042560:12345-0@lo:400:kworker.0 Request processed in 68us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.591062:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784584919.591121:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:978ed13c-6d08-4d66-8bb5-98db460a5248:3323:1871272569042560:0@lo:400:kworker.0 00000100:00100000:3.0:1784584919.591185:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569042944 00000100:00100000:3.0:1784584919.591189:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569042944 00000100:00100000:1.0:1784584919.591316:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569043456 00000100:00100000:1.0:1784584919.591370:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784584919.591377:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569043456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1784584919.591401:0:14938:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784584919.591445:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569043456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584919.591452:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1784584919.591471:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784584919.591503:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569043456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584919.591660:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584919.591728:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569043200:0@lo:400:kworker.0 00000100:00100000:0.0:1784584919.591766:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584919.602197:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584919.602274:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569043328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584919.602313:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584919.602373:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569042688 00000100:00100000:2.0:1784584919.602383:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569042688 00000100:00100000:2.0:1784584919.602453:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569042816 00000100:00100000:2.0:1784584919.602456:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569042816 00000100:00100000:2.0:1784584919.602485:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584919.602493:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569042688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584919.602555:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569042688:12345-0@lo:400:kworker.0 Request processed in 62us (10895us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584919.602582:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1784584919.602601:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584919.602607:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569042816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584919.602641:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569042816:12345-0@lo:400:kworker.0 Request processed in 34us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584919.602647:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784584919.602725:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569042816:0@lo:400:kworker.0 00000100:00100000:2.0:1784584919.602754:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569043328 00000100:00100000:2.0:1784584919.602757:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569043328 00000100:00100000:2.0:1784584919.602776:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584919.602781:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569043328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584919.602799:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584919.602839:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871272569043328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584919.602845:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784584919.602894:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3321:1871272569043328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1784584919.606719:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569043072 00000100:00100000:3.0:1784584919.606802:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569043072 00000100:00100000:3.0:1784584919.606933:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569043200 00000100:00100000:3.0:1784584919.606938:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569043200 00000100:00100000:3.0:1784584919.606967:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584919.606979:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569042944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584919.607098:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569042944:12345-0@lo:400:kworker.0 Request processed in 122us (16655us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.607127:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784584919.607153:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784584919.607159:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c2478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272569043072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584919.607200:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c2478380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272569043072:12345-0@lo:400:kworker.0 Request processed in 41us (16334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584919.607205:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1784584919.607787:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584919.607802:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569043200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584919.607854:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569043200:12345-0@lo:400:kworker.0 Request processed in 58us (16086us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584919.608107:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1784584919.608203:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784584919.608210:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784584919.608261:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569042944:0@lo:400:kworker.0 00000100:00100000:0.0:1784584919.609664:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569042688:0@lo:400:kworker.0 00000100:00100000:0.0:1784584919.609749:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569043200:0@lo:400:kworker.0 00000100:00100000:3.0:1784584919.610262:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272569043072:0@lo:400:kworker.0 00010000:00010000:3.0:1784584920.157237:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784584920.680221:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ef0695b2-b73d-4d2d-9d3e-86d6851e1509 00000001:00100000:2.0:1784584920.680238:0:6631:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1721672f-5c01-4877-84ad-d16d0b74ee5d 00010000:00010000:0.0:1784584921.181379:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784584921.710750:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1721672f-5c01-4877-84ad-d16d0b74ee5d 00000001:00100000:0.0:1784584921.710770:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ef0695b2-b73d-4d2d-9d3e-86d6851e1509 00010000:00010000:0.0:1784584922.203874:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784584922.467482:0:16165:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784584923.235727:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784584923.775859:0:7511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1721672f-5c01-4877-84ad-d16d0b74ee5d 00000100:00100000:1.0:1784584924.100137:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584924.100187:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584924.100229:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584924.100275:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584924.100294:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584924.100313:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584924.100339:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584924.100374:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549136128 00000100:00100000:1.0:1784584924.100385:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549136128 00000100:00100000:1.0:1784584924.100451:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549136384 00000100:00100000:1.0:1784584924.100455:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549136384 00000100:00100000:1.0:1784584924.100470:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549136000 00000100:00100000:1.0:1784584924.100473:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549136000 00000100:00100000:1.0:1784584924.100484:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549136512 00000100:00100000:1.0:1784584924.100486:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549136512 00000100:00100000:1.0:1784584924.100502:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1784584924.100513:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2357:x1871272549136128:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584924.100688:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2357:x1871272549136128:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 175us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584924.100725:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:1.0:1784584924.100745:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1784584924.100752:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2357:x1871272549136384:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584924.100780:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2357:x1871272549136384:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584924.100786:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1784584924.100798:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1784584924.100804:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2357:x1871272549136000:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584924.100828:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2357:x1871272549136000:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 24us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584924.100846:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:1.0:1784584924.100860:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1784584924.100866:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2357:x1871272549136512:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584924.100891:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2357:x1871272549136512:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584924.100897:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:1.0:1784584924.100919:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549135744 00000100:00100000:1.0:1784584924.100923:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549135744 00000100:00100000:1.0:1784584924.100950:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:1.0:1784584924.100957:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:2357:x1871272549135744:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584924.100982:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:2357:x1871272549135744:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584924.100989:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 103 00000100:00100000:1.0:1784584924.101027:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549135872 00000100:00100000:1.0:1784584924.101031:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549135872 00000100:00100000:1.0:1784584924.101059:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549136256 00000100:00100000:1.0:1784584924.101062:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549136256 00000100:00100000:1.0:1784584924.101081:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1784584924.101086:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2357:x1871272549135872:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584924.101115:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2357:x1871272549135872:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 29us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584924.101122:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:1.0:1784584924.101134:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1784584924.101140:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2357:x1871272549136256:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584924.101174:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2357:x1871272549136256:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 34us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584924.101181:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00080000:1.0:1784584924.101205:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784584924.101211:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784584924.101213:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1784584924.258353:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784584924.699972:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784584924.700005:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569043584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1784584924.700097:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584924.700175:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569043584 00000100:00100000:2.0:1784584924.700184:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569043584 00000100:00100000:2.0:1784584924.700257:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784584924.700268:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569043584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584924.700327:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584924.700385:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569043584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584924.700393:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1784584924.700420:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584924.700463:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569043584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584924.700738:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272569044096:0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.701880:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:978ed13c-6d08-4d66-8bb5-98db460a5248:3320:1871272569043712:0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.701977:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584924.702041:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569044224:0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.702073:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584924.702101:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784584924.702108:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569043840:0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.702138:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584924.702156:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c6c247ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569044352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584924.702178:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584924.702219:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569043712 00000100:00100000:2.0:1784584924.702229:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569043712 00000100:00100000:2.0:1784584924.702284:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784584924.702293:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3320:x1871272569043712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.702353:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3320:x1871272569043712:12345-0@lo:400:kworker.0 Request processed in 61us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584924.702361:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1784584924.702401:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569044224 00000100:00100000:2.0:1784584924.702405:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569044224 00000100:00100000:2.0:1784584924.702442:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584924.702449:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569044224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.702502:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569044224:12345-0@lo:400:kworker.0 Request processed in 53us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584924.702509:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784584924.702529:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569043840 00000100:00100000:2.0:1784584924.702532:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569043840 00000100:00100000:2.0:1784584924.702562:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784584924.702568:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569043840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.702599:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569043840:12345-0@lo:400:kworker.0 Request processed in 32us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584924.702605:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784584924.702649:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569043840:0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.702672:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:978ed13c-6d08-4d66-8bb5-98db460a5248:3320:1871272569043712:0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.702682:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569044224:0@lo:400:kworker.0 00000100:00080000:2.0:1784584924.702744:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784584924.702749:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584924.702772:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569044352 00000100:00100000:2.0:1784584924.702776:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569044352 00000100:00100000:2.0:1784584924.702798:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584924.702804:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569044352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584924.702838:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584924.702880:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569044352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584924.702887:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784584924.702917:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c6c247ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569044352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1784584924.702947:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569043968:0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.702984:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584924.703014:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569043968 00000100:00100000:2.0:1784584924.703018:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569043968 00000100:00100000:2.0:1784584924.703042:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584924.703048:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569043968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.703080:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871272569043968:12345-0@lo:400:kworker.0 Request processed in 32us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584924.703087:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784584924.703112:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871272569043968:0@lo:400:kworker.0 00000100:00100000:2.0:1784584924.704561:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584924.704731:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569044096 00000100:00100000:3.0:1784584924.704740:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569044096 00000100:00100000:3.0:1784584924.704815:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1784584924.704824:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272569044096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584924.704894:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871272569044096:12345-0@lo:400:kworker.0 Request processed in 71us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584924.704901:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1784584924.705040:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784584924.705082:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3323:1871272569044096:0@lo:400:kworker.0 00010000:00010000:0.0:1784584925.281531:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584925.728466:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1784584926.304386:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784584926.440162:0:16313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe408343b0 20000000:00000080:1.0:1784584926.440183:0:16313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97c6c111cc00 uarg=0000000000000000 20000000:01000000:1.0:1784584926.440224:0:16313:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784584926.440232:0:16313:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784584926.440237:0:16313:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784584926.443285:0:16314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1784584926.444341:0:16313:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784584926.451815:0:16313:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784584926.451862:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.451891:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff20aa expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.451902:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff20f7 expref: 18 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.451910:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff2167 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.451923:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb321b expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.451953:0:16313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb327d expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.451962:0:16313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.452025:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb327d expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.452046:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb327d expref: 12 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584926.452065:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044480:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584926.454065:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb321b expref: 12 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.454085:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb321b expref: 12 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584926.454102:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044608:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584926.454805:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff2167 expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.454819:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff2167 expref: 18 pid: 14296 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584926.454831:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044736:0@lo:104: 00000100:00100000:2.0:1784584926.454893:0:16313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584926.455028:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff20f7 expref: 18 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.455036:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff20f7 expref: 18 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584926.455045:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044864:0@lo:104: 00000100:00100000:2.0:1784584926.455068:0:16313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784584926.458008:0:16313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x787d778cc3ff20aa expref: 18 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.458031:0:16313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x787d778cc3ff20aa expref: 18 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584926.458048:0:16313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044992:0@lo:104: 00000100:00100000:2.0:1784584926.458294:0:16313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584926.458487:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584926.459310:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584926.463601:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569044736 00000100:00100000:0.0:1784584926.463624:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569044736 00000100:00100000:0.0:1784584926.463744:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569044864 00000100:00100000:0.0:1784584926.463749:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569044864 00000100:00100000:0.0:1784584926.463771:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584926.463783:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+4:16313:x1871272569044736:12345-0@lo:104: 00010000:00010000:0.0:1784584926.463806:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.463969:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784584926.463977:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+4:16313:x1871272569044736:12345-0@lo:104: Request processed in 196us (9083us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584926.463986:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784584926.464008:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584926.464015:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:16313:x1871272569044864:12345-0@lo:104: 00010000:00010000:0.0:1784584926.464024:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.464059:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784584926.464065:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:16313:x1871272569044864:12345-0@lo:104: Request processed in 51us (8996us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584926.464071:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784584926.464503:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549136640 00000100:00100000:0.0:1784584926.464509:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549136640 00010000:00010000:0.0:1784584926.464540:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb327d expref: 13 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584926.464579:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549136768 00000100:00100000:0.0:1784584926.464583:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549136768 00010000:00010000:0.0:1784584926.464596:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb321b expref: 14 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584926.464611:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1784584926.464618:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c6c247ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+14:2354:x1871272549136640:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584926.464632:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584926.464639:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb327d expref: 14 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584926.466373:0:14287:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784584926.466397:0:14287:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1784584926.466598:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:1.0:1784584926.466615:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+14:2355:x1871272549136768:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584926.466641:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584926.466670:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb321b expref: 14 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584926.466688:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb321b expref: 14 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584926.466741:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584926.466823:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+14:2355:x1871272549136768:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 214us (7518us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584926.466832:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00010000:00010000:0.0:1784584926.468583:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb327d expref: 13 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.468612:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584926.468711:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c6c247ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:2354:x1871272549136640:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 4074us (10208us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584926.468725:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00010000:00010000:0.0:1784584926.468791:0:15679:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784584926.468801:0:15679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.468811:0:15679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c801818e00 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584926.468816:0:15679:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.468828:0:15679:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584926.468836:0:15679:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584926.468842:0:15679:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784584926.468908:0:15679:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.468915:0:15679:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584926.468948:0:15679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.468979:0:15679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c801818e00/0x787d778cc3ff2167 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff216e expref: -99 pid: 15602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.468996:0:15679:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784584926.468999:0:15679:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.469005:0:15679:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed800 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:0.0:1784584926.469008:0:15679:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.469015:0:15679:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784584926.469021:0:15679:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784584926.469026:0:15679:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784584926.469040:0:15679:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.469045:0:15679:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784584926.469052:0:15679:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.469058:0:15679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7faaed800/0x787d778cc3ff20f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff20fe expref: -99 pid: 14933 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584926.469066:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584926.469074:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584926.469076:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784584926.469084:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784584926.469125:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569045120:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584926.470983:0:14284:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784584926.471014:0:14284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569044992 00000100:00100000:3.0:1784584926.471025:0:14284:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569044992 00000100:00100000:3.0:1784584926.471088:0:14284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584926.471111:0:14284:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f45cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:16313:x1871272569044992:12345-0@lo:104: 00010000:00010000:3.0:1784584926.471147:0:14284:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.473085:0:14284:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784584926.473113:0:14284:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f45cd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+3:16313:x1871272569044992:12345-0@lo:104: Request processed in 2001us (14815us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584926.473126:0:14284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1784584926.474278:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784584926.474318:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584926.474332:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed600 already unused, calling callback (ffffffffc1d99c20) 10000000:00010000:1.0:1784584926.474337:0:14290:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584926.474348:0:14290:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784584926.474355:0:14290:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584926.474361:0:14290:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784584926.474425:0:14290:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584926.474433:0:14290:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784584926.474478:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584926.474486:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.152@tcp lock: ffff97c7faaed600/0x787d778cc3ff20aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x787d778cc3ff20b1 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584926.474508:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584926.474510:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784584926.474512:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584926.475387:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:978ed13c-6d08-4d66-8bb5-98db460a5248:3323:1871272569045248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784584926.475478:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584926.475613:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569045248 00000100:00100000:3.0:1784584926.475623:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569045248 00010000:00010000:3.0:1784584926.475675:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff20f7 expref: 19 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584926.475740:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584926.475751:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3323:x1871272569045248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584926.475770:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584926.475776:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff20f7 expref: 19 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.475789:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff20f7 expref: 19 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.475813:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584926.475859:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3323:x1871272569045248:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584926.475867:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784584926.475916:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4256d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:978ed13c-6d08-4d66-8bb5-98db460a5248:3323:1871272569045248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584926.476638:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:978ed13c-6d08-4d66-8bb5-98db460a5248:3320:1871272569045376:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784584926.476720:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584926.476838:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569045376 00000100:00100000:1.0:1784584926.476850:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569045376 00010000:00010000:1.0:1784584926.476879:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff20aa expref: 19 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584926.476915:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784584926.476922:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3320:x1871272569045376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784584926.476935:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584926.476940:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff20aa expref: 19 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584926.476952:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff20aa expref: 19 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584926.476971:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584926.477007:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3320:x1871272569045376:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584926.477014:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784584926.477083:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:978ed13c-6d08-4d66-8bb5-98db460a5248:3320:1871272569045376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784584926.477290:0:16313:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d0324c00 going to sleep for 11 seconds 00010000:00010000:2.0:1784584926.477312:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7faaecc00/0x787d778cc3ff2390 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb327d expref: 12 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584926.477365:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584926.477398:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044480:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584926.477414:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf600/0x787d778cc3ff2358 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb321b expref: 11 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584926.477423:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044608:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584926.477434:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044736:0@lo:104: 00010000:00010000:2.0:1784584926.477445:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bfe00/0x787d778cc3ff20fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff20f7 expref: 18 pid: 14293 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584926.477448:0:14287:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569045120 00000100:00100000:3.0:1784584926.477453:0:14287:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569045120 00000100:00100000:2.0:1784584926.477467:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044864:0@lo:104: 00010000:00010000:3.0:1784584926.477471:0:14287:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff2167 expref: 18 pid: 14296 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.477478:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff20b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff20aa expref: 18 pid: 14295 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584926.477487:0:16313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16313:1871272569044992:0@lo:104: 00000100:00100000:3.0:1784584926.477496:0:14287:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784584926.477502:0:14287:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff97e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:978ed13c-6d08-4d66-8bb5-98db460a5248+17:3322:x1871272569045120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784584926.477512:0:14287:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584926.477516:0:14287:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x787d778cc3ff2167 expref: 17 pid: 14296 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.477518:0:16313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477526:0:14287:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x787d778cc3ff2167 expref: 17 pid: 14296 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477586:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff216e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x787d778cc3ff2167 expref: 17 pid: 14296 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477601:0:14287:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477610:0:14287:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477627:0:14287:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477633:0:14287:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477640:0:14287:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477664:0:14287:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477671:0:14287:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2e00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584926.477675:0:14287:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.477685:0:14287:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.477959:0:16313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584926.477967:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.478882:0:14287:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.478901:0:14287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97c7c7fa2e00/0x787d778cc3ff23ba lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584926.478920:0:14287:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584926.479008:0:14287:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff97e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:978ed13c-6d08-4d66-8bb5-98db460a5248+16:3322:x1871272569045120:12345-0@lo:103:ldlm_bl.0 Request processed in 1503us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584926.479019:0:14287:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784584926.479375:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4257800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569045120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784584927.324224:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584927.815932:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584927.816556:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549136896 00000100:00100000:0.0:1784584927.816570:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549136896 00000100:00100000:0.0:1784584927.816672:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:0.0:1784584927.816685:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+11:13720:x1871272549136896:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584927.816737:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584927.816765:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff23c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32ae expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584927.816801:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff23c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32ae expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584927.816815:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42be800/0x787d778cc3ff23c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32ae expref: 12 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584927.816826:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be800, rc 0) 00000100:00100000:0.0:1784584927.816908:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13720:x1871272549136896:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 226us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584927.816916:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 105 00000100:00100000:1.0:1784584927.827722:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584927.827805:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549137024 00000100:00100000:2.0:1784584927.827818:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549137024 00000100:00100000:2.0:1784584927.827895:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:2.0:1784584927.827906:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13720:x1871272549137024:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584927.828304:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13720:x1871272549137024:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 398us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584927.828314:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 106 00000100:00100000:2.0:1784584927.847491:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584927.847966:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549137152 00000100:00100000:3.0:1784584927.847980:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549137152 00000100:00100000:3.0:1784584927.848230:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:3.0:1784584927.848244:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13720:x1871272549137152:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584927.848552:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13720:x1871272549137152:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 309us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584927.848561:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 107 00000100:00100000:1.0:1784584927.876261:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584927.876368:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549137280 00000100:00100000:3.0:1784584927.876379:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549137280 00000100:00100000:3.0:1784584927.876450:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:3.0:1784584927.876462:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+12:13720:x1871272549137280:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584927.876484:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584927.876507:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff23c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32b5 expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584927.876541:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff23c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32b5 expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584927.876553:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7faaec000/0x787d778cc3ff23c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32b5 expref: 13 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584927.876564:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec000, rc 0) 00000100:00100000:3.0:1784584927.876795:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13720:x1871272549137280:12345-192.168.203.52@tcp:101:ll_cfg_requeue.0 Request processed in 335us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584927.876804:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 108 00000100:00100000:3.0:1784584927.878520:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584927.878723:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549137408 00000100:00100000:0.0:1784584927.878736:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549137408 00000100:00100000:0.0:1784584927.878797:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:0.0:1784584927.878825:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13720:x1871272549137408:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784584927.879200:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13720:x1871272549137408:12345-192.168.203.52@tcp:501:ll_cfg_requeue.0 Request processed in 376us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584927.879210:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 109 00000100:00100000:1.0:1784584927.885581:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584927.885660:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549137536 00000100:00100000:3.0:1784584927.885679:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549137536 00000100:00100000:3.0:1784584927.885766:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 110 00000100:00100000:3.0:1784584927.885777:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13720:x1871272549137536:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584927.886053:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:13720:x1871272549137536:12345-192.168.203.52@tcp:503:ll_cfg_requeue.0 Request processed in 268us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584927.886062:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 110 00010000:00010000:2.0:1784584928.347813:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784584928.412767:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784584928.413163:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c6c2145800 from 10 10000000:01000000:3.0:1784584928.413169:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784584928.413213:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaec400/0x787d778cc3ff23cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584928.413224:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7faaec400/0x787d778cc3ff23cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584928.413235:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7faaec400/0x787d778cc3ff23cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584928.413257:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569045504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784584928.413324:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584928.413377:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584928.413629:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569045504 00000100:00100000:1.0:1784584928.413650:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569045504 00000100:00100000:1.0:1784584928.413731:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784584928.413742:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+16:14298:x1871272569045504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584928.413757:0:14293:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584928.413772:0:14293:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7feb0f600/0x787d778cc3ff23d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff23cf expref: -99 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.413812:0:14293:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7feb0f600/0x787d778cc3ff23d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff23cf expref: 17 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.413834:0:14293:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7feb0f600/0x787d778cc3ff23d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff23cf expref: 17 pid: 14293 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.413843:0:14293:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7feb0f600, rc 0) 00000100:00100000:1.0:1784584928.413896:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+17:14298:x1871272569045504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584928.413903:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784584928.413955:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569045504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584928.413970:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7faaec400/0x787d778cc3ff23cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff23d6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.413979:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7faaec400/0x787d778cc3ff23cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff23d6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584928.414033:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569045632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.414060:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584928.414081:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8350d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584928.414094:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569045632 00000100:00100000:1.0:1784584928.414097:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569045632 00000100:00100000:1.0:1784584928.414117:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784584928.414123:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+17:14298:x1871272569045632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.414361:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+17:14298:x1871272569045632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584928.414367:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1784584928.414397:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569045632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.414434:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569045760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.414470:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584928.414482:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8350d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784584928.414493:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569045760 00000100:00100000:1.0:1784584928.414496:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569045760 00000100:00100000:1.0:1784584928.414516:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784584928.414522:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+17:14298:x1871272569045760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.414664:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+17:14298:x1871272569045760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584928.414670:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784584928.414731:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569045760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784584928.418808:0:16393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1784584928.419035:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784584928.419057:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584928.419068:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7faaec400/0x787d778cc3ff23cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff23d6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.419079:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7faaec400/0x787d778cc3ff23cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff23d6 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584928.419089:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584928.419091:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7c41a3000 from 10 10000000:01000000:1.0:1784584928.419094:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584928.419136:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7feb0fc00/0x787d778cc3ff23dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.419144:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7feb0fc00/0x787d778cc3ff23dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.419486:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7feb0fc00/0x787d778cc3ff23dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584928.419512:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569045888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.419577:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584928.419669:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8350d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784584928.419764:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569045888 00000100:00100000:2.0:1784584928.419772:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569045888 00000100:00100000:2.0:1784584928.419851:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1784584928.419867:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+17:14298:x1871272569045888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784584928.419880:0:14296:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584928.419893:0:14296:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7c7fa2800/0x787d778cc3ff23e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff23dd expref: -99 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584928.419916:0:14296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7c7fa2800/0x787d778cc3ff23e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff23dd expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584928.419927:0:14296:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7c7fa2800/0x787d778cc3ff23e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff23dd expref: 18 pid: 14296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584928.419949:0:14296:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2800, rc 0) 00000100:00100000:2.0:1784584928.419998:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:14298:x1871272569045888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584928.420004:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1784584928.420080:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569045888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784584928.420094:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7feb0fc00/0x787d778cc3ff23dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff23e4 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584928.420103:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7feb0fc00/0x787d778cc3ff23dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff23e4 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584928.420153:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584928.420192:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584928.421182:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784584928.421227:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569046016 00000100:00100000:1.0:1784584928.421245:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569046016 00000100:00100000:1.0:1784584928.421569:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784584928.421578:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+18:14298:x1871272569046016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.421893:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:978ed13c-6d08-4d66-8bb5-98db460a5248+18:14298:x1871272569046016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584928.421901:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1784584928.421992:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784584928.422035:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784584928.422083:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584928.422099:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569046144 00000100:00100000:2.0:1784584928.422106:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569046144 00000100:00100000:3.0:1784584928.422114:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c5c93f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784584928.422147:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1784584928.422716:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:14298:x1871272569046144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784584928.422895:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+18:14298:x1871272569046144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 739us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584928.422903:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1784584928.423012:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c89f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784584928.425257:0:16394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1784584928.426864:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784584928.426909:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584928.426922:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7feb0fc00/0x787d778cc3ff23dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff23e4 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.426934:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7feb0fc00/0x787d778cc3ff23dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff23e4 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784584928.426945:0:14298:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784584928.426948:0:14298:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff97c7f428a800 from 10 10000000:01000000:1.0:1784584928.426951:0:14298:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784584928.426991:0:14298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e800/0x787d778cc3ff23eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.426999:0:14298:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e800/0x787d778cc3ff23eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.427509:0:14298:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e800/0x787d778cc3ff23eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584928.427533:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.427594:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584928.427657:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569046272 00000100:00100000:0.0:1784584928.427665:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569046272 00000100:00100000:0.0:1784584928.427749:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1784584928.427760:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+18:14298:x1871272569046272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784584928.427774:0:14295:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584928.427797:0:14295:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff23f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x787d778cc3ff23eb expref: -99 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584928.427824:0:14295:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff23f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x787d778cc3ff23eb expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584928.427831:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d83506c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784584928.427837:0:14295:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97c7f42bf800/0x787d778cc3ff23f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x787d778cc3ff23eb expref: 19 pid: 14295 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584928.427847:0:14295:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf800, rc 0) 00000100:00100000:0.0:1784584928.428232:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:14298:x1871272569046272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 472us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584928.428240:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1784584928.428274:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784584928.428292:0:14298:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e800/0x787d778cc3ff23eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff23f2 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.428302:0:14298:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e800/0x787d778cc3ff23eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x787d778cc3ff23f2 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584928.428359:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.428384:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584928.428412:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d83506c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784584928.428458:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569046400 00000100:00100000:2.0:1784584928.428462:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569046400 00000100:00100000:2.0:1784584928.428488:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1784584928.428494:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:14298:x1871272569046400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784584928.429045:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:14298:x1871272569046400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 548us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584928.429060:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1784584928.429114:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.429148:0:14298:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784584928.429188:0:14298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584928.429253:0:14298:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d83506c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784584928.429289:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569046528 00000100:00100000:0.0:1784584928.429294:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569046528 00000100:00100000:0.0:1784584928.429358:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1784584928.429366:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:14298:x1871272569046528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784584928.429523:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:14298:x1871272569046528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584928.429537:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1784584928.429608:0:14298:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:978ed13c-6d08-4d66-8bb5-98db460a5248:14298:1871272569046528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784584928.431958:0:16395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1784584928.432254:0:14298:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1784584928.432341:0:14298:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.152@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784584928.432354:0:14298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e800/0x787d778cc3ff23eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff23f2 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584928.432382:0:14298:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.152@tcp lock: ffff97c7feb0e800/0x787d778cc3ff23eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x787d778cc3ff23f2 expref: -99 pid: 14298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584929.235650:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584929.235753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584929.235824:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549138048 00000100:00100000:1.0:1784584929.235835:0:15677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549138048 00000100:00100000:0.0:1784584929.235858:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549137792 00000100:00100000:0.0:1784584929.235863:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549137792 00000100:00100000:1.0:1784584929.235911:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1784584929.235916:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1784584929.235927:0:15677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2355:x1871272549138048:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584929.235938:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2355:x1871272549137792:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:0.0:1784584929.236006:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2355:x1871272549137792:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 81us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584929.236015:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1784584929.236152:0:15677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2355:x1871272549138048:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 229us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584929.236160:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00080000:2.0:1784584929.236356:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784584929.236363:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784584929.241215:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584929.241354:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584929.241391:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584929.241430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584929.241433:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549137664 00000100:00100000:2.0:1784584929.241443:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549137664 00000100:00100000:1.0:1784584929.241474:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549137920 00000100:00100000:1.0:1784584929.241479:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549137920 00000100:00100000:2.0:1784584929.241516:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00100000:1.0:1784584929.241524:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549138432 00000100:00100000:1.0:1784584929.241529:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549138432 00000100:00100000:2.0:1784584929.241530:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:2354:x1871272549137664:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584929.241592:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:2354:x1871272549137664:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 67us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584929.241599:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 120 00000100:00080000:2.0:1784584929.241643:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784584929.241648:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784584929.241792:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1784584929.241801:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2354:x1871272549137920:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584929.241836:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1784584929.241839:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2354:x1871272549137920:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 37us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584929.241848:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1784584929.241854:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2354:x1871272549138432:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584929.241890:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2354:x1871272549138432:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 44us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584929.241897:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1784584929.241936:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549138176 00000100:00100000:0.0:1784584929.241942:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549138176 00000100:00100000:0.0:1784584929.241990:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:0.0:1784584929.241997:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2354:x1871272549138176:12345-192.168.203.52@tcp:400:kworker.0 00000100:00080000:3.0:1784584929.242157:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584929.248915:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2354:x1871272549138176:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 6899us (7503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584929.248936:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1784584929.257519:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584929.257623:0:14934:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549138304 00000100:00100000:3.0:1784584929.257649:0:14934:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549138304 00000100:00100000:3.0:1784584929.257756:0:14934:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:3.0:1784584929.257767:0:14934:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2355:x1871272549138304:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584929.257859:0:14934:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2355:x1871272549138304:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 93us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584929.257868:0:14934:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00080000:2.0:1784584929.258392:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784584929.374809:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584929.820223:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784584929.820243:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569046656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1784584929.820312:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584929.820419:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569046784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1784584929.820450:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584929.820535:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569046656 00000100:00100000:3.0:1784584929.820553:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569046656 00000100:00100000:3.0:1784584929.820608:0:14938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569046784 00000100:00100000:3.0:1784584929.820611:0:14938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569046784 00000100:00100000:3.0:1784584929.820641:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584929.820672:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569046656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1784584929.820733:0:14938:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584929.820776:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569046656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584929.820783:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784584929.820799:0:14938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584929.820806:0:14938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569046784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1784584929.820824:0:14938:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784584929.820850:0:14938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569046784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584929.820856:0:14938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784584929.820890:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569046656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1784584929.821147:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569046784:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1784584929.821165:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784584929.821169:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584929.822278:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584929.822380:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569047040:0@lo:400:kworker.0 00000100:00100000:1.0:1784584929.822429:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584929.822458:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784584929.822463:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569047168:0@lo:400:kworker.0 00000100:00100000:1.0:1784584929.822484:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584929.822511:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569047040 00000100:00100000:1.0:1784584929.822516:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569047040 00000100:00100000:1.0:1784584929.822548:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569047168 00000100:00100000:1.0:1784584929.822561:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569047168 00000100:00100000:1.0:1784584929.822594:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784584929.822600:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569047040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584929.822668:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871272569047040:12345-0@lo:400:kworker.0 Request processed in 67us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584929.822675:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784584929.822688:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784584929.822718:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569047168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584929.822742:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569047168:12345-0@lo:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584929.822747:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1784584929.822776:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569047168:0@lo:400:kworker.0 00000100:00100000:1.0:1784584929.822786:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871272569047040:0@lo:400:kworker.0 00000100:00080000:1.0:1784584929.822820:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584929.826173:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784584929.826201:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569047296:0@lo:400:kworker.0 00000100:00100000:3.0:1784584929.826269:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584929.826326:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569047296 00000100:00100000:3.0:1784584929.826333:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569047296 00000100:00100000:3.0:1784584929.826383:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784584929.826392:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569047296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584929.826483:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871272569047296:12345-0@lo:400:kworker.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584929.826491:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1784584929.826510:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784584929.826538:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3323:1871272569047296:0@lo:400:kworker.0 00000100:00100000:0.0:1784584929.827776:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569046912:0@lo:400:kworker.0 00000100:00100000:0.0:1784584929.827825:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584929.828297:0:14295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569046912 00000100:00100000:3.0:1784584929.828310:0:14295:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569046912 00000100:00100000:3.0:1784584929.828365:0:14295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1784584929.828373:0:14295:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3322:x1871272569046912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784584929.828419:0:14295:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3322:x1871272569046912:12345-0@lo:400:kworker.0 Request processed in 47us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584929.828426:0:14295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1784584929.828980:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:978ed13c-6d08-4d66-8bb5-98db460a5248:3322:1871272569046912:0@lo:400:kworker.0 00000100:00100000:1.0:1784584929.950240:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584929.950432:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549138560 00000100:00100000:0.0:1784584929.950441:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549138560 00000100:00100000:0.0:1784584929.950514:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:0.0:1784584929.950524:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:14377:x1871272549138560:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584929.950544:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584929.950562:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff23f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32bc expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584929.950617:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584929.950640:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584929.950654:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584929.950668:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584929.950675:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584929.950680:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.951894:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0f000/0x787d778cc3ff240e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.951910:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0f000/0x787d778cc3ff240e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.951920:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0f000/0x787d778cc3ff240e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584929.952019:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784584929.952024:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584929.952238:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0f000/0x787d778cc3ff240e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952256:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952260:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952265:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952269:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bec00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584929.952272:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952276:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952285:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c200) 00010000:00010000:1.0:1784584929.952287:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584929.952290:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952294:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952302:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952305:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952309:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952318:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584929.952321:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952326:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952334:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97c7c636fd00) 00010000:00010000:1.0:1784584929.952336:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584929.952338:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952344:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff2407 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952381:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff23f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32bc expref: 8 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952450:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0f000/0x787d778cc3ff240e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32bc expref: 7 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584929.952458:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c7c4d20700) 00010000:00010000:1.0:1784584929.952460:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784584929.952462:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7feb0f000, rc 0) 00000100:00100000:1.0:1784584929.952577:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:14377:x1871272549138560:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 2052us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584929.952586:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1784584929.955226:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584929.955427:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549138816 00000100:00100000:3.0:1784584929.955443:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549138816 00000100:00100000:3.0:1784584929.955527:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1784584929.955537:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:14377:x1871272549138816:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584929.955564:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584929.955592:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2415 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32c3 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.955727:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.955746:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.955759:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.958824:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.958848:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.958860:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.961250:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff242a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.961269:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff242a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.961280:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff242a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584929.961293:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1784584929.962945:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.962960:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.962968:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.962974:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584929.962979:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.962987:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.963002:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97c7c4d20700) 00010000:00010000:3.0:1784584929.963005:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584929.963009:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.963591:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff241c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.963610:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.963615:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.963620:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.963637:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584929.963863:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.963874:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.963884:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97c7e189c900) 00010000:00010000:3.0:1784584929.963887:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584929.963890:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.963896:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2423 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.964362:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2415 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32c3 expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.964393:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaede00/0x787d778cc3ff242a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32c3 expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584929.964401:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:3.0:1784584929.964403:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584929.964406:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaede00, rc 0) 00000100:00100000:3.0:1784584929.964479:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:14377:x1871272549138816:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 8942us (9260us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1784584929.964487:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1784584929.993178:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584929.993519:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549138944 00000100:00100000:1.0:1784584929.993529:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549138944 00000100:00100000:1.0:1784584929.993589:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1784584929.993598:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:14377:x1871272549138944:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784584929.993797:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:14377:x1871272549138944:12345-192.168.203.52@tcp:59:lhsmtool_posix.0 Request processed in 197us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584929.993805:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 17 00000100:00100000:1.0:1784584930.056525:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584930.056962:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549139072 00000100:00100000:2.0:1784584930.056973:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549139072 00000100:00100000:2.0:1784584930.057033:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1784584930.057044:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:14383:x1871272549139072:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584930.057087:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584930.057111:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff2438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32ca expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057182:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057196:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057207:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057222:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057230:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057236:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057931:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057942:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057949:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057956:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3a00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584930.057966:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057974:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.057986:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c200) 00010000:00010000:2.0:1784584930.057989:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584930.057993:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058000:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff243f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058013:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058019:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058025:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058030:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584930.058033:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058039:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058046:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c7c58a0c00) 00010000:00010000:2.0:1784584930.058048:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584930.058057:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058063:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2000/0x787d778cc3ff2446 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058099:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff2438 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32ca expref: 10 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058109:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c200) 00010000:00010000:2.0:1784584930.058112:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584930.058115:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff2438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32ca expref: 10 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.058124:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa2e00, rc 0) 00000100:00100000:2.0:1784584930.058428:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:14383:x1871272549139072:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1384us (1908us total) trans 0 rc 301/301 00000100:00100000:2.0:1784584930.058437:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 18 00000100:00100000:2.0:1784584930.068523:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584930.068763:0:14310:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549139200 00000100:00100000:0.0:1784584930.068774:0:14310:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549139200 00000100:00100000:0.0:1784584930.068831:0:14310:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1784584930.068841:0:14310:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:14383:x1871272549139200:12345-192.168.203.52@tcp:700:lfs.0 00000100:00100000:0.0:1784584930.068938:0:14310:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:14383:x1871272549139200:12345-192.168.203.52@tcp:700:lfs.0 Request processed in 98us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584930.068945:0:14310:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:0.0:1784584930.077442:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584930.077546:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549139456 00000100:00100000:1.0:1784584930.077556:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549139456 00000100:00100000:1.0:1784584930.077633:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 19 00000100:00100000:1.0:1784584930.077644:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:14383:x1871272549139456:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:1.0:1784584930.077732:0:14301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584930.077759:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec200/0x787d778cc3ff237b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3245 expref: 9 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.077781:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c200) 00010000:00010000:1.0:1784584930.077786:0:14301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784584930.078089:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.078105:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32a7 expref: 5 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.078114:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.078148:0:14301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32a7 expref: 5 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.081498:0:14301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32a7 expref: 5 pid: 14301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584930.081517:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1871272569047424:192.168.203.52@tcp:104: 00000100:00100000:1.0:1784584930.081648:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d8350300 going to sleep for 11 seconds 00000100:00100000:3.0:1784584930.084456:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584930.084620:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549139584 00000100:00100000:0.0:1784584930.084637:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549139584 00010000:00010000:0.0:1784584930.084677:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32a7 expref: 6 pid: 14301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584930.084753:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1784584930.084763:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2354:x1871272549139584:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584930.084779:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584930.084785:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32a7 expref: 6 pid: 14301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.084799:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32a7 expref: 6 pid: 14301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.084821:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c200) 00010000:00010000:0.0:1784584930.084827:0:14286:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.084837:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.084844:0:14286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.084880:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584930.084926:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2354:x1871272549139584:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 165us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584930.084934:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00010000:00010000:1.0:1784584930.085512:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff23b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32a7 expref: 5 pid: 14301 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584930.085528:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c801b0ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1871272569047424:192.168.203.52@tcp:104: 00010000:00010000:1.0:1784584930.085548:0:14301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.085556:0:14301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.085563:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.085587:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.085597:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.085616:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584930.090801:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784584930.090836:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.090847:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.090854:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.090861:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0e600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584930.090865:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.090874:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.090891:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c200) 00010000:00010000:1.0:1784584930.090895:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584930.090900:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.090907:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff244d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584930.090927:0:14301:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b6ee2bc7 reply state 00000000c43823fb transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584930.090937:0:14301:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784584930.091369:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4256680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+10:14383:x1871272549139456:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 13720us (13928us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1784584930.091379:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 19 00010000:00010000:1.0:1784584930.097550:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.097572:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.097580:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.097586:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7feb0ec00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584930.097591:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.097598:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.097634:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c7c4d20900) 00010000:00010000:1.0:1784584930.097637:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584930.097642:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.097649:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ec00/0x787d778cc3ff2454 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584930.221532:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584930.221740:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549139712 00000100:00100000:3.0:1784584930.221753:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549139712 00000100:00100000:3.0:1784584930.221827:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1784584930.221839:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:14391:x1871272549139712:12345-192.168.203.52@tcp:101:lctl.0 00010000:00010000:3.0:1784584930.221872:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584930.221904:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff245b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32d1 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.221986:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2462 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.222003:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.222018:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584930.222118:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784584930.222123:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584930.222171:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2462 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.222201:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff245b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32d1 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.222227:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed000/0x787d778cc3ff2462 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32d1 expref: 10 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.222237:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584930.222240:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584930.222244:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaed000, rc 0) 00000100:00100000:3.0:1784584930.222328:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+10:14391:x1871272549139712:12345-192.168.203.52@tcp:101:lctl.0 Request processed in 491us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584930.222336:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 20 00000100:00100000:3.0:1784584930.265519:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584930.265682:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549139840 00000100:00100000:0.0:1784584930.265732:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549139840 00000100:00100000:0.0:1784584930.265802:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1784584930.265814:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:14392:x1871272549139840:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584930.265839:0:15235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584930.265873:0:15235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32d8 expref: -99 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.265955:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff2470 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.265972:0:15235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff2470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.265986:0:15235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff2470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584930.266062:0:15235:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784584930.266067:0:15235:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584930.266253:0:15235:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff2470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.266284:0:15235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32d8 expref: 7 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.266318:0:15235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be400/0x787d778cc3ff2470 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32d8 expref: 6 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.266328:0:15235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584930.266331:0:15235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584930.266335:0:15235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be400, rc 0) 00000100:00100000:0.0:1784584930.266412:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:14392:x1871272549139840:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 601us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584930.266420:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 21 00000100:00100000:0.0:1784584930.269731:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584930.269901:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549139968 00000100:00100000:3.0:1784584930.269913:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549139968 00000100:00100000:3.0:1784584930.269986:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:3.0:1784584930.269997:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:14392:x1871272549139968:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:3.0:1784584930.270022:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584930.270049:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2477 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32df expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.270307:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.270342:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.270357:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.270377:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.270384:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.270391:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.278914:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff248c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.278939:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff248c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.278952:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff248c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584930.279792:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1784584930.279799:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584930.279834:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff248c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.279850:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280084:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280098:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280108:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584930.280113:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280120:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280205:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:3.0:1784584930.280208:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584930.280213:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280220:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff247e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280240:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280246:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280252:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280257:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584930.280268:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280274:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280282:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c7e189ce00) 00010000:00010000:3.0:1784584930.280284:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584930.280287:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280293:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff2485 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280335:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2477 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32df expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280350:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff248c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32df expref: 7 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.280357:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c7e189c800) 00010000:00010000:3.0:1784584930.280359:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784584930.280361:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaece00, rc 0) 00000100:00100000:3.0:1784584930.282323:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+7:14392:x1871272549139968:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 12316us (12617us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584930.282337:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 22 00000100:00100000:0.0:1784584930.289515:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584930.289580:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549140224 00000100:00100000:1.0:1784584930.289591:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549140224 00000100:00100000:1.0:1784584930.289667:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1784584930.289678:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+7:14392:x1871272549140224:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:1.0:1784584930.289731:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584930.289752:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff2493 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32e6 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584930.289888:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784584930.290018:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff2493 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32e6 expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.290032:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:1.0:1784584930.290036:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784584930.290042:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e600/0x787d778cc3ff2493 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32e6 expref: 9 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.290669:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7feb0e600, rc 0) 00000100:00100000:1.0:1784584930.290765:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4257480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+8:14392:x1871272549140224:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 1086us (1255us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1784584930.290774:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 23 00000100:00100000:1.0:1784584930.304487:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584930.304593:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549140480 00000100:00100000:2.0:1784584930.304602:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549140480 00000100:00100000:2.0:1784584930.304677:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:2.0:1784584930.304688:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+8:14392:x1871272549140480:12345-192.168.203.52@tcp:36:lfs.0 00010000:00010000:2.0:1784584930.304790:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584930.304817:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff248c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32df expref: 8 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.304841:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c7e189c800) 00010000:00010000:2.0:1784584930.304874:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784584930.305359:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.305375:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.305385:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784584930.305606:0:14302:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004345b49c reply state 00000000621df470 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584930.305617:0:14302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1784584930.305653:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1784584930.305788:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+9:14392:x1871272549140480:12345-192.168.203.52@tcp:36:lfs.0 Request processed in 1092us (1300us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1784584930.305798:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 24 00000100:00100000:1.0:1784584930.307923:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:3.0:1784584930.307924:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.307944:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.307982:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.307990:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bea00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584930.307995:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.308004:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.308025:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c7c636fe00) 00010000:00010000:3.0:1784584930.308029:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1784584930.308034:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.308041:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff24a1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584930.308254:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549140736 00000100:00100000:0.0:1784584930.308264:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549140736 00000100:00100000:0.0:1784584930.308313:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:0.0:1784584930.308322:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+8:14392:x1871272549140736:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:0.0:1784584930.308574:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+9:14392:x1871272549140736:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 252us (661us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1784584930.308582:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:1.0:1784584930.312396:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584930.312592:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549140992 00000100:00100000:2.0:1784584930.312604:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549140992 00000100:00100000:2.0:1784584930.312790:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:2.0:1784584930.312803:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+9:14392:x1871272549140992:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:2.0:1784584930.312834:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584930.312872:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff24a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32ed expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.312982:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313000:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313014:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313031:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313039:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313046:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584930.313230:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784584930.313361:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313370:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313398:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313404:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584930.313408:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313416:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313430:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:2.0:1784584930.313433:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584930.313439:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313446:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff24af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313461:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313467:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313473:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313478:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:2.0:1784584930.313481:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313498:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313508:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c7c58a0c00) 00010000:00010000:2.0:1784584930.313510:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784584930.313513:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313519:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff24b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313565:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff24a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32ed expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313577:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:2.0:1784584930.313580:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784584930.313583:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3a00/0x787d778cc3ff24a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32ed expref: 11 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584930.313593:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3a00, rc 0) 00000100:00100000:2.0:1784584930.313679:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+10:14392:x1871272549140992:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 878us (1298us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1784584930.313687:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 25 00000100:00100000:3.0:1784584930.319555:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584930.319992:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549141120 00000100:00100000:0.0:1784584930.320006:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549141120 00000100:00100000:0.0:1784584930.320090:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:0.0:1784584930.320103:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+10:14392:x1871272549141120:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584930.320135:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584930.320180:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32f4 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.320303:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.320320:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.320335:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584930.320401:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784584930.320406:0:14303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584930.320433:0:14303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.320466:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32f4 expref: 12 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.320508:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32f4 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.320518:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c7c636fb00) 00010000:00010000:0.0:1784584930.320521:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784584930.320525:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfa00, rc 0) 00000100:00100000:0.0:1784584930.320609:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+11:14392:x1871272549141120:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 508us (1070us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584930.320617:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 26 00000100:00100000:2.0:1784584930.326025:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584930.326121:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549141248 00000100:00100000:3.0:1784584930.326133:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549141248 00000100:00100000:3.0:1784584930.326219:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1784584930.326232:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+12:14392:x1871272549141248:12345-192.168.203.52@tcp:37:lfs.0 00000100:00100000:2.0:1784584930.331000:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1721672f-5c01-4877-84ad-d16d0b74ee5d+12:14392:x1871272549141248:12345-192.168.203.52@tcp:37:lfs.0 Request processed in 4755us (4973us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584930.331018:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:3.0:1784584930.335973:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584930.336184:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549141504 00000100:00100000:2.0:1784584930.336198:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549141504 00000100:00100000:2.0:1784584930.336273:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:2.0:1784584930.336284:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8ba1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+11:14392:x1871272549141504:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1784584930.336610:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8ba1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+12:14392:x1871272549141504:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 326us (659us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1784584930.336619:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:3.0:1784584930.390067:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584930.391245:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549141632 00000100:00100000:0.0:1784584930.391262:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549141632 00000100:00100000:0.0:1784584930.391347:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:0.0:1784584930.391359:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+10:14398:x1871272549141632:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:0.0:1784584930.391382:0:15235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584930.391404:0:15235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb32fb expref: -99 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391466:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391481:0:15235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391491:0:15235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391506:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391526:0:15235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391532:0:15235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391656:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff24e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391665:0:15235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff24e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391672:0:15235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff24e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584930.391726:0:15235:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784584930.391731:0:15235:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584930.391781:0:15235:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff24e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391792:0:15235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391798:0:15235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391804:0:15235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391810:0:15235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bfe00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584930.391815:0:15235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391828:0:15235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391840:0:15235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584930.391843:0:15235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584930.391847:0:15235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391854:0:15235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff24d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391867:0:15235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391873:0:15235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391878:0:15235:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391883:0:15235:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584930.391885:0:15235:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391891:0:15235:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391896:0:15235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff97c7c636f900) 00010000:00010000:0.0:1784584930.391898:0:15235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584930.391901:0:15235:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391915:0:15235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff24e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391943:0:15235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32fb expref: 12 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391956:0:15235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf600/0x787d778cc3ff24e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32fb expref: 11 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.391963:0:15235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c7c636fb00) 00010000:00010000:0.0:1784584930.391966:0:15235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784584930.391968:0:15235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bf600, rc 0) 00000100:00100000:0.0:1784584930.392032:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+11:14398:x1871272549141632:12345-192.168.203.52@tcp:101:bash.0 Request processed in 676us (1981us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584930.392039:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 27 00000100:00100000:2.0:1784584930.396284:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00010000:00010000:0.0:1784584930.396395:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784584930.397482:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549141888 00000100:00100000:3.0:1784584930.397493:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549141888 00000100:00100000:3.0:1784584930.397596:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:3.0:1784584930.397607:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+11:14398:x1871272549141888:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:3.0:1784584930.397654:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584930.397683:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff24ee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3302 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.398609:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.398641:0:14302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32f4 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.398651:0:14302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.398688:0:14302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32f4 expref: 11 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.398720:0:14302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32f4 expref: 11 pid: 14303 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584930.398735:0:14302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c89880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14302:1871272569047552:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584930.398877:0:14302:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7efc2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584930.404618:0:14302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c89880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14302:1871272569047552:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584930.404670:0:14302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584930.407132:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584930.407225:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549142016 00000100:00100000:1.0:1784584930.407234:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549142016 00010000:00010000:1.0:1784584930.407271:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32f4 expref: 12 pid: 14303 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584930.407322:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:1.0:1784584930.407332:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c8010bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+12:2354:x1871272549142016:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584930.407347:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584930.407354:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32f4 expref: 12 pid: 14303 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.407380:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32f4 expref: 12 pid: 14303 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.407401:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff24cb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb32f4 expref: 12 pid: 14303 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.407418:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c7c636fb00) 00010000:00010000:1.0:1784584930.407423:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.407434:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.407442:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.407473:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584930.407530:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c8010bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+11:2354:x1871272549142016:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 199us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584930.407538:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00010000:00010000:0.0:1784584930.407864:0:14302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.407873:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.407897:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.407918:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.407925:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.408641:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.408653:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.409115:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584930.409127:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784584930.409214:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.409222:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.409228:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.409245:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:1.0:1784584930.409249:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.409255:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.409278:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c7c636fb00) 00010000:00010000:1.0:1784584930.409280:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784584930.410524:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.410540:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff24f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784584930.410561:0:14302:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac1f8f7f reply state 00000000912e4a58 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584930.410571:0:14302:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784584930.410633:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff24ee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3302 expref: 14 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.410651:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3302 expref: 13 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.410746:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:1.0:1784584930.410749:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1784584930.410752:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be600, rc 0) 00000100:00100000:1.0:1784584930.410928:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+14:14398:x1871272549141888:12345-192.168.203.52@tcp:101:bash.0 Request processed in 13321us (14651us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1784584930.410948:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00010000:00010000:0.0:1784584930.423834:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.423853:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.423860:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.423866:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584930.423871:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.423878:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.423917:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff97c7c636f900) 00010000:00010000:0.0:1784584930.423921:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584930.423927:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.423933:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff24fc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584930.446500:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584930.446764:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549142144 00000100:00100000:1.0:1784584930.446773:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549142144 00000100:00100000:1.0:1784584930.446837:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:1.0:1784584930.446848:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+13:14398:x1871272549142144:12345-192.168.203.52@tcp:101:bash.0 00010000:00010000:1.0:1784584930.446872:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584930.446893:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e400/0x787d778cc3ff2511 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3309 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.446955:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.446970:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.446982:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584930.447022:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784584930.447026:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784584930.447045:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.447055:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.447089:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e400/0x787d778cc3ff2511 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3309 expref: 15 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.447106:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3309 expref: 14 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.447133:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:1.0:1784584930.447136:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784584930.447139:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7feb0ea00, rc 0) 00000100:00100000:1.0:1784584930.447200:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+14:14398:x1871272549142144:12345-192.168.203.52@tcp:101:bash.0 Request processed in 353us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584930.447207:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:2.0:1784584930.458664:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584930.458763:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549142400 00000100:00100000:3.0:1784584930.458773:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549142400 00000100:00100000:3.0:1784584930.458830:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1784584930.458839:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+14:14398:x1871272549142400:12345-192.168.203.52@tcp:35:bash.0 00000100:00100000:3.0:1784584930.459180:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+15:14398:x1871272549142400:12345-192.168.203.52@tcp:35:bash.0 Request processed in 341us (523us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1784584930.459203:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:3.0:1784584930.550821:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584930.550961:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549142656 00000100:00100000:0.0:1784584930.550973:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549142656 00000100:00100000:0.0:1784584930.551056:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1784584930.551076:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+15:14408:x1871272549142656:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584930.551109:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584930.551136:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff251f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3310 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584930.551302:0:14303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784584930.551458:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff251f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3310 expref: 17 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.551475:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97c7e189c900) 00010000:00010000:0.0:1784584930.551478:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584930.551485:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff251f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3310 expref: 17 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.551501:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfe00, rc 0) 00000100:00100000:0.0:1784584930.551589:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+16:14408:x1871272549142656:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 524us (782us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1784584930.551618:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 30 00000100:00100000:0.0:1784584930.555198:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584930.555327:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549142912 00000100:00100000:3.0:1784584930.555339:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549142912 00000100:00100000:3.0:1784584930.555413:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1784584930.555426:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+16:14408:x1871272549142912:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:3.0:1784584930.555803:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4256d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+17:14408:x1871272549142912:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 378us (616us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1784584930.555811:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:2.0:1784584930.593612:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584930.593848:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549143168 00000100:00100000:0.0:1784584930.593861:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549143168 00000100:00100000:0.0:1784584930.593938:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1784584930.593950:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+17:14411:x1871272549143168:12345-192.168.203.52@tcp:101:lfs.0 00010000:00010000:0.0:1784584930.593991:0:15235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584930.594018:0:15235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff252d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3317 expref: -99 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.594180:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2534 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.594197:0:15235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2534 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.594211:0:15235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2534 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584930.594225:0:15235:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784584930.594381:0:15235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff252d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3317 expref: 20 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.594404:0:15235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2534 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3317 expref: 19 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584930.594413:0:15235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584930.594416:0:15235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784584930.594438:0:15235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bec00, rc 0) 00000100:00100000:0.0:1784584930.596018:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+19:14411:x1871272549143168:12345-192.168.203.52@tcp:101:lfs.0 Request processed in 2055us (2403us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1784584930.596042:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 31 00000100:00100000:0.0:1784584930.605375:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584930.605498:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549143296 00000100:00100000:1.0:1784584930.605511:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549143296 00000100:00100000:1.0:1784584930.605678:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:1.0:1784584930.605875:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+19:2355:x1871272549143296:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784584930.605899:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784584930.605935:0:14286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff2534 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3317 expref: 19 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.606293:0:14286:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:1.0:1784584930.606301:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784584930.606425:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:2355:x1871272549143296:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 735us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584930.606444:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1784584930.608142:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584930.608299:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549143424 00000100:00100000:3.0:1784584930.608312:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549143424 00000100:00100000:3.0:1784584930.608419:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:3.0:1784584930.608431:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14411:x1871272549143424:12345-192.168.203.52@tcp:54:lfs.0 00010000:00010000:3.0:1784584930.608539:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.608561:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.608576:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.608615:0:14303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.608634:0:14303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.608665:0:14303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.608673:0:14303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584930.608678:0:14303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.608687:0:14303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.608742:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584930.608746:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784584930.608753:0:14303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.608759:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff2542 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584930.609423:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14411:x1871272549143424:12345-192.168.203.52@tcp:54:lfs.0 Request processed in 991us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584930.609434:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 32 00000100:00100000:0.0:1784584930.618609:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584930.619159:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549143680 00000100:00100000:2.0:1784584930.619172:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549143680 00000100:00100000:2.0:1784584930.619246:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1784584930.619258:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14411:x1871272549143680:12345-192.168.203.52@tcp:35:lfs.0 00000100:00100000:2.0:1784584930.619598:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4255880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+19:14411:x1871272549143680:12345-192.168.203.52@tcp:35:lfs.0 Request processed in 341us (1002us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1784584930.619607:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000040:00080000:1.0:1784584930.845084:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784584930.925277:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584930.925496:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549143936 00000100:00100000:1.0:1784584930.925509:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549143936 00000100:00100000:1.0:1784584930.925588:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:1.0:1784584930.925600:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+19:14443:x1871272549143936:12345-192.168.203.52@tcp:101:cat.0 00010000:00010000:1.0:1784584930.925920:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584930.925967:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e400/0x787d778cc3ff2549 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb331e expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.926105:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff2550 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.926124:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff2550 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.926141:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff2550 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784584930.926154:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784584930.926338:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0e400/0x787d778cc3ff2549 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb331e expref: 22 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.926363:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff2550 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb331e expref: 21 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584930.926373:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:1.0:1784584930.926376:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784584930.926381:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7feb0fe00, rc 0) 00000100:00100000:1.0:1784584930.926463:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4256300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+21:14443:x1871272549143936:12345-192.168.203.52@tcp:101:cat.0 Request processed in 864us (1201us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1784584930.926472:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 33 00000100:00100000:0.0:1784584930.934509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584930.935546:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549144192 00000100:00100000:2.0:1784584930.935562:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549144192 00000100:00100000:2.0:1784584930.935657:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:2.0:1784584930.935671:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+21:14443:x1871272549144192:12345-192.168.203.52@tcp:35:cat.0 00000100:00100000:0.0:1784584930.936136:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584930.936166:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4254380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+22:14443:x1871272549144192:12345-192.168.203.52@tcp:35:cat.0 Request processed in 496us (1671us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1784584930.936197:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 8 00000100:00100000:3.0:1784584930.942114:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549144320 00000100:00100000:3.0:1784584930.942137:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549144320 00000100:00100000:3.0:1784584930.942260:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:3.0:1784584930.942273:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+22:2354:x1871272549144320:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584930.942295:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584930.942331:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff2550 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb331e expref: 22 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584930.942385:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584930.942391:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584930.942593:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+21:2354:x1871272549144320:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 321us (6458us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584930.942603:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1784584931.018946:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584931.019114:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549144576 00000100:00100000:2.0:1784584931.019127:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549144576 00000100:00100000:2.0:1784584931.019233:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:2.0:1784584931.019247:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+21:14449:x1871272549144576:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:2.0:1784584931.019285:0:14302:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584931.019314:0:14302:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff255e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3325 expref: -99 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.019460:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.019479:0:14302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3302 expref: 22 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.019488:0:14302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3309 expref: 22 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.019498:0:14302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.019546:0:14302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3309 expref: 22 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.019562:0:14302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3309 expref: 22 pid: 14301 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584931.019579:0:14302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f400a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14302:1871272569047680:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584931.019789:0:14302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3302 expref: 22 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.019800:0:14302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3302 expref: 22 pid: 14302 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584931.019810:0:14302:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f400bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14302:1871272569047808:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584931.019840:0:14302:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4269f00 going to sleep for 11 seconds 00000100:00080000:3.0:1784584931.020258:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784584931.029436:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584931.029479:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584931.029556:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549144704 00000100:00100000:1.0:1784584931.029566:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549144704 00010000:00010000:1.0:1784584931.029626:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3309 expref: 23 pid: 14301 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584931.029805:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549144832 00000100:00100000:1.0:1784584931.029809:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549144832 00010000:00010000:1.0:1784584931.029821:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3302 expref: 24 pid: 14302 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584931.029920:0:14302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f400a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14302:1871272569047680:192.168.203.52@tcp:104: 00000100:00100000:2.0:1784584931.029934:0:14302:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f400bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14302:1871272569047808:192.168.203.52@tcp:104: 00010000:00010000:2.0:1784584931.029964:0:14302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584931.032016:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1784584931.032051:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7ff97d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:2355:x1871272549144704:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584931.032080:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584931.032094:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3309 expref: 24 pid: 14301 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032112:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3309 expref: 24 pid: 14301 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032142:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0ea00/0x787d778cc3ff2518 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3309 expref: 24 pid: 14301 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032164:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584931.032170:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032201:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032209:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584931.032307:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7ff97d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+23:2355:x1871272549144704:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 275us (2884us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584931.032316:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:0.0:1784584931.032399:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 12 00000100:00100000:0.0:1784584931.032405:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+22:2355:x1871272549144832:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784584931.032411:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784584931.032415:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3302 expref: 22 pid: 14302 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032424:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3302 expref: 22 pid: 14302 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032559:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2503 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3302 expref: 22 pid: 14302 timeout: 526 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032571:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584931.032575:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032583:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032591:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.032643:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784584931.032675:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+21:2355:x1871272549144832:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 269us (3195us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584931.032682:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 12 00010000:00010000:2.0:1784584931.034774:0:14302:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.034796:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784584931.034829:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784584931.035097:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3200/0x787d778cc3ff255e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3325 expref: 22 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.035122:0:14302:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3600/0x787d778cc3ff2565 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3325 expref: 21 pid: 14302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.035132:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:2.0:1784584931.035365:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784584931.035370:0:14302:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3600, rc 0) 00000100:00100000:2.0:1784584931.035475:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+21:14449:x1871272549144576:12345-192.168.203.52@tcp:101:dd.0 Request processed in 16231us (16542us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1784584931.035485:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 34 00000100:00100000:3.0:1784584931.038175:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584931.038354:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549145088 00000100:00100000:0.0:1784584931.038366:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549145088 00000100:00100000:0.0:1784584931.038450:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 35 00000100:00100000:0.0:1784584931.038462:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+21:14449:x1871272549145088:12345-192.168.203.52@tcp:36:dd.0 00010000:00010000:0.0:1784584931.038879:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.038900:0:15235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.038914:0:15235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584931.038984:0:15235:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1784584931.039016:0:15235:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c4d6bed reply state 0000000090d02445 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584931.039027:0:15235:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784584931.039170:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:14449:x1871272549145088:12345-192.168.203.52@tcp:36:dd.0 Request processed in 710us (1007us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1784584931.039177:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 35 00000020:00080000:0.0:1784584931.039184:0:15235:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784584931.042729:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.042751:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.042759:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.042766:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584931.042772:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.042779:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.042801:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584931.042805:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584931.042811:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.042818:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2573 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584931.044302:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584931.044561:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549145216 00000100:00100000:0.0:1784584931.044573:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549145216 00000100:00100000:0.0:1784584931.044796:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1784584931.044824:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+23:14449:x1871272549145216:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:0.0:1784584931.044856:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584931.044885:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff257a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb332c expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.044960:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff257a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb332c expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.044977:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff257a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb332c expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.045000:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584931.045003:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584931.045008:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be600, rc 0) 00000100:00100000:0.0:1784584931.045082:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:14449:x1871272549145216:12345-192.168.203.52@tcp:101:dd.0 Request processed in 262us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584931.045090:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 36 00000100:00100000:0.0:1784584931.084505:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584931.084614:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549145472 00000100:00100000:3.0:1784584931.084636:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549145472 00000100:00100000:3.0:1784584931.084748:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1784584931.084760:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:14449:x1871272549145472:12345-192.168.203.52@tcp:103:dd.0 00010000:00010000:3.0:1784584931.084779:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584931.084823:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff257a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb332c expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.084846:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584931.084852:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584931.084914:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+23:14449:x1871272549145472:12345-192.168.203.52@tcp:103:dd.0 Request processed in 156us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584931.084923:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1784584931.087655:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584931.087795:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549145600 00000100:00100000:0.0:1784584931.087806:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549145600 00000100:00100000:0.0:1784584931.087885:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:0.0:1784584931.087896:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+23:14449:x1871272549145600:12345-192.168.203.52@tcp:58:dd.0 00010000:00010000:0.0:1784584931.088027:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.088049:0:15235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.088080:0:15235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784584931.089682:0:15235:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784584931.090550:0:15235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1784584931.090655:0:15235:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1784584931.091337:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+23:14449:x1871272549145600:12345-192.168.203.52@tcp:58:dd.0 Request processed in 3433us (3686us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584931.091353:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 37 00000100:00100000:1.0:1784584931.107768:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584931.108245:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549145728 00000100:00100000:0.0:1784584931.108259:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549145728 00000100:00100000:0.0:1784584931.108343:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 38 00000100:00100000:0.0:1784584931.108355:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+23:14449:x1871272549145728:12345-192.168.203.52@tcp:101:dd.0 00010000:00010000:0.0:1784584931.108385:0:14303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584931.108412:0:14303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff2588 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3333 expref: -99 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.108490:0:14303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.108502:0:14303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff2588 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3333 expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.108526:0:14303:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.108541:0:14303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff2588 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3333 expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.108580:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584931.108583:0:14303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584931.108588:0:14303:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff2588 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3333 expref: 24 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.108595:0:14303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfe00, rc 0) 00000100:00100000:0.0:1784584931.108889:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:14449:x1871272549145728:12345-192.168.203.52@tcp:101:dd.0 Request processed in 535us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584931.108898:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 38 00010000:00010000:2.0:1784584931.421059:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784584931.869902:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784584931.869916:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584931.870581:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1784584931.870591:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1784584931.870788:0:14333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f400bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14333:1871272569047936:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784584931.877914:0:14333:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7c4269480 going to sleep for 11 seconds 00000100:00100000:1.0:1784584931.887527:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584931.888974:0:14312:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549145856 00000100:00100000:3.0:1784584931.888990:0:14312:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549145856 00000100:00100000:3.0:1784584931.889066:0:14312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1784584931.889079:0:14312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+25:14450:x1871272549145856:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1784584931.889188:0:14312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+25:14450:x1871272549145856:12345-192.168.203.52@tcp:900:lhsmtool_posix.0 Request processed in 112us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584931.889197:0:14312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:2.0:1784584931.889659:0:14333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f400bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14333:1871272569047936:192.168.203.52@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784584931.894881:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584931.894923:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549145984 00000100:00100000:2.0:1784584931.894935:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549145984 00000100:00100000:2.0:1784584931.895006:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:2.0:1784584931.895019:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:14450:x1871272549145984:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784584931.895069:0:14301:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784584931.895198:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:14450:x1871272549145984:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 181us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584931.895207:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 39 00000100:00100000:0.0:1784584931.907361:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584931.907766:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549146112 00000100:00100000:3.0:1784584931.907778:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549146112 00000100:00100000:3.0:1784584931.907845:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:3.0:1784584931.907870:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:14450:x1871272549146112:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784584931.907996:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.908016:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.908032:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909431:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909522:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909533:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909572:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909581:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909587:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784584931.909644:0:14302:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1784584931.909648:0:14302:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784584931.909662:0:14302:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909675:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909711:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909718:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909724:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed400 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584931.909727:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909735:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909844:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:3.0:1784584931.909849:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584931.909853:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909859:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed400/0x787d778cc3ff258f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909878:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909883:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909888:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909892:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed200 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584931.909903:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909909:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909918:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff97c7e189c700) 00010000:00010000:3.0:1784584931.909920:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584931.909922:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909927:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaed200/0x787d778cc3ff2596 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909943:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909949:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909955:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909960:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584931.909963:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909968:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909980:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:3.0:1784584931.909983:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584931.909992:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.909998:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff259d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584931.910098:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:14450:x1871272549146112:12345-192.168.203.52@tcp:34:lhsmtool_posix.0 Request processed in 2239us (2750us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584931.910119:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 40 00000100:00100000:3.0:1784584931.913247:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584931.913603:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549146368 00000100:00100000:0.0:1784584931.913629:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549146368 00000100:00100000:0.0:1784584931.913754:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1784584931.913768:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:14450:x1871272549146368:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584931.913795:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584931.913826:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff25a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb333a expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.913972:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.913991:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914007:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584931.914042:0:14301:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1784584931.914194:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914203:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914209:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914217:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bfa00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584931.914221:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914229:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914243:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584931.914246:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784584931.914250:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914256:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914310:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff25a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb333a expref: 26 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914322:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97c7e189c400) 00010000:00010000:0.0:1784584931.914324:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784584931.914335:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff25a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb333a expref: 26 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.914350:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bea00, rc 0) 00000100:00100000:0.0:1784584931.914436:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+25:14450:x1871272549146368:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 671us (1196us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1784584931.914445:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 41 00000100:00100000:0.0:1784584931.930851:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584931.931030:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549146496 00000100:00100000:3.0:1784584931.931044:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549146496 00000100:00100000:3.0:1784584931.931114:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:3.0:1784584931.931125:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+25:14450:x1871272549146496:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784584931.931168:0:14303:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784584931.931305:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+25:14450:x1871272549146496:12345-192.168.203.52@tcp:53:lhsmtool_posix.0 Request processed in 182us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584931.931314:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 42 00000100:00100000:0.0:1784584931.936871:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584931.937583:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549146752 00000100:00100000:2.0:1784584931.937597:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549146752 00000100:00100000:2.0:1784584931.937683:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:2.0:1784584931.937730:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+25:14450:x1871272549146752:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784584931.937773:0:15235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784584931.937809:0:15235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25b9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3341 expref: -99 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784584931.939586:0:15235:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:2.0:1784584931.939600:0:15235:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1784584931.939661:0:15235:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:2.0:1784584931.940886:0:15235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff25c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.940911:0:15235:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff25c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.940925:0:15235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff25c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.941012:0:15235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25b9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3341 expref: 28 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.941035:0:15235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff25c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3341 expref: 27 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.941044:0:15235:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:2.0:1784584931.941048:0:15235:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784584931.941052:0:15235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7c7fa3c00, rc 0) 00000100:00100000:2.0:1784584931.941140:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+27:14450:x1871272549146752:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 3445us (4283us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1784584931.941151:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 43 00000100:00100000:1.0:1784584931.946377:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584931.947224:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549147008 00000100:00100000:3.0:1784584931.947239:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549147008 00000100:00100000:3.0:1784584931.947319:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:3.0:1784584931.947329:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+27:14450:x1871272549147008:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784584931.947415:0:14302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584931.947450:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3c00/0x787d778cc3ff25c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3341 expref: 27 pid: 15235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.947470:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c58a0d00) 00010000:00010000:3.0:1784584931.947482:0:14302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784584931.947529:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.947546:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.947557:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584931.949486:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:0.0:1784584931.949506:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1784584931.949534:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1784584931.949780:0:14302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.949805:0:14302:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.949819:0:14302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951380:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951393:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951400:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951406:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaece00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584931.951410:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951417:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951443:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97c7c636fb00) 00010000:00010000:3.0:1784584931.951446:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584931.951450:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951457:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaece00/0x787d778cc3ff25ce lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951475:0:14302:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951481:0:14302:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951487:0:14302:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951492:0:14302:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584931.951495:0:14302:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951501:0:14302:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951508:0:14302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf678fdd1 (ffff97c7e189c700) 00010000:00010000:3.0:1784584931.951511:0:14302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584931.951514:0:14302:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.951520:0:14302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7faaec600/0x787d778cc3ff25d5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf678fdd1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14302 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584931.952119:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+13:14450:x1871272549147008:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 4785us (5750us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784584931.952129:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 44 00000100:00100000:1.0:1784584931.954990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584931.955101:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549147136 00000100:00100000:0.0:1784584931.955114:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549147136 00000100:00100000:0.0:1784584931.955192:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1784584931.955203:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+13:14450:x1871272549147136:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584931.955230:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584931.955261:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25dc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3348 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.955308:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff25e3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.955322:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff25e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.955336:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff25e3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.955475:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff25dc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3348 expref: 15 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.955496:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bec00/0x787d778cc3ff25e3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3348 expref: 14 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.955506:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c636f400) 00010000:00010000:0.0:1784584931.955509:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784584931.955514:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bec00, rc 0) 00000100:00100000:0.0:1784584931.955588:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+14:14450:x1871272549147136:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 387us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584931.955596:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 45 00000100:00100000:0.0:1784584931.957998:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584931.958084:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549147392 00000100:00100000:3.0:1784584931.958096:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549147392 00000100:00100000:3.0:1784584931.958165:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 46 00000100:00100000:3.0:1784584931.958177:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+14:14450:x1871272549147392:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784584931.958313:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.958353:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584931.958370:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784584931.959051:0:14303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1784584931.959064:0:14303:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 427066371215ns, next at 428066368823ns, rc = 0 00000004:00010000:2.0:1784584931.959179:0:14303:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ac3e1f1c reply state 00000000bce9c23b transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584931.959191:0:14303:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784584931.959329:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+16:14450:x1871272549147392:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 1151us (1341us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1784584931.959338:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 46 00010000:00010000:0.0:1784584931.960561:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.960577:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.960584:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.960592:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584931.960597:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.960605:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.960658:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c636f400) 00010000:00010000:0.0:1784584931.960662:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784584931.960667:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.960673:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2e00/0x787d778cc3ff25ea lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584931.961453:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584931.961526:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549147520 00000100:00100000:1.0:1784584931.961539:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549147520 00000100:00100000:1.0:1784584931.961604:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1784584931.961625:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+15:14450:x1871272549147520:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784584931.961661:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784584931.961687:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb334f expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584931.961819:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb334f expref: 16 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584931.961834:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb334f expref: 16 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784584931.961856:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c636f400) 00010000:00010000:1.0:1784584931.961859:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784584931.961862:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7feb0fe00, rc 0) 00000100:00100000:1.0:1784584931.961943:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+16:14450:x1871272549147520:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 328us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584931.961950:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 47 00000100:00100000:1.0:1784584931.969500:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584931.969598:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549147648 00000100:00100000:3.0:1784584931.969620:0:15677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549147648 00000100:00100000:3.0:1784584931.969765:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:3.0:1784584931.969779:0:15677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2354:x1871272549147648:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1784584931.970235:0:15677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2354:x1871272549147648:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 458us (746us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784584931.970248:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00080000:1.0:1784584931.970747:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784584931.973631:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584931.973747:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549147904 00000100:00100000:3.0:1784584931.973765:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549147904 00000100:00100000:2.0:1784584931.973982:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:2.0:1784584931.973998:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+16:14450:x1871272549147904:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784584931.974326:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+17:14450:x1871272549147904:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 331us (719us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1784584931.974336:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 9 00000100:00100000:0.0:1784584931.976761:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584931.977002:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549148160 00000100:00100000:2.0:1784584931.977015:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549148160 00000100:00100000:2.0:1784584931.977093:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:2.0:1784584931.977103:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+17:14450:x1871272549148160:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784584931.977392:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+17:14450:x1871272549148160:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 289us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584931.977423:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 48 00000100:00100000:1.0:1784584931.980396:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584931.980511:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549148288 00000100:00100000:0.0:1784584931.980524:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549148288 00000100:00100000:0.0:1784584931.980600:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1784584931.980621:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c801b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+17:14450:x1871272549148288:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584931.980648:0:14301:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584931.980676:0:14301:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff25f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3356 expref: -99 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.980810:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff25ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.980828:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff25ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.980842:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff25ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784584931.981196:0:14301:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784584931.981236:0:14301:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff25ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.981271:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff25f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3356 expref: 19 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.981292:0:14301:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff25ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3356 expref: 18 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584931.981302:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c636f400) 00010000:00010000:0.0:1784584931.981305:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784584931.981309:0:14301:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42be600, rc 0) 00000100:00100000:0.0:1784584931.981481:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c801b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14450:x1871272549148288:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 870us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584931.981490:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 49 00000100:00100000:0.0:1784584931.997963:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584931.998121:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549148416 00000100:00100000:3.0:1784584931.998133:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549148416 00000100:00100000:3.0:1784584931.998209:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:3.0:1784584931.998221:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+6:2355:x1871272549148416:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784584931.998248:0:14937:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784584931.998278:0:14937:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb335d expref: -99 pid: 14937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784584931.998312:0:14937:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5e9ae3, blocks: 0x1 00010000:00010000:3.0:1784584931.998361:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1784584931.998368:0:14937:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584931.998381:0:14937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb335d expref: 7 pid: 14937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.998405:0:14937:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb335d expref: 7 pid: 14937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584931.998421:0:14937:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7faaec600, rc 0) 00000100:00100000:3.0:1784584931.998499:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2355:x1871272549148416:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 280us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584931.998507:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1784584932.007011:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584932.007183:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549148672 00000100:00100000:2.0:1784584932.007196:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549148672 00000100:00100000:2.0:1784584932.007268:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:2.0:1784584932.007280:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14450:x1871272549148672:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784584932.007418:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14450:x1871272549148672:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 140us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584932.007427:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 50 00000100:00100000:1.0:1784584932.012799:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584932.012896:0:15235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549148800 00000100:00100000:3.0:1784584932.012911:0:15235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549148800 00000100:00100000:3.0:1784584932.012985:0:15235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 51 00000100:00100000:3.0:1784584932.013004:0:15235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14450:x1871272549148800:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1784584932.054935:0:15235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14450:x1871272549148800:12345-192.168.203.52@tcp:44:lhsmtool_posix.0 Request processed in 41924us (42134us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584932.054952:0:15235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 51 00000001:00080000:0.0:1784584932.055178:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:0.0:1784584932.055193:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1784584932.055202:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1784584932.055640:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784584932.055658:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569048064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1784584932.055744:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784584932.055823:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569048064 00000100:00100000:3.0:1784584932.055832:0:15677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569048064 00000100:00100000:3.0:1784584932.055894:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784584932.055904:0:15677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569048064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1784584932.056106:0:15677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784584932.056111:0:15677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1784584932.056114:0:15677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784584932.056117:0:15677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784584931 -> 1784584931 00002000:00010000:3.0:1784584932.056120:0:15677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784584932.056383:0:15677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3322:x1871272569048064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 479us (637us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1784584932.056391:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1784584932.056420:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1784584932.061077:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97c7c5c8b100/2, rc 0, transno 8589934595 00000100:00100000:0.0:1784584932.061100:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569048064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1784584932.061713:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584932.062375:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549148928 00000100:00100000:3.0:1784584932.062387:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549148928 00000100:00100000:3.0:1784584932.062463:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1784584932.062475:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2354:x1871272549148928:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784584932.062631:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5395f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2354:x1871272549148928:12345-192.168.203.52@tcp:16:lhsmtool_posix.0 Request processed in 158us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584932.062640:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1784584932.066205:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584932.066328:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549149184 00000100:00100000:2.0:1784584932.066340:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549149184 00000100:00100000:2.0:1784584932.066412:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 52 00000100:00100000:2.0:1784584932.066424:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+14:14450:x1871272549149184:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784584932.066497:0:14303:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584932.066533:0:14303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff25ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3356 expref: 14 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.066558:0:14303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c636f400) 00010000:00010000:2.0:1784584932.066564:0:14303:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784584932.066603:0:14303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.066630:0:14303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.066642:0:14303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784584932.067009:0:14303:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003c47c400 reply state 00000000b5ed4624 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.067020:0:14303:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784584932.067140:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+15:14450:x1871272549149184:12345-192.168.203.52@tcp:36:lhsmtool_posix.0 Request processed in 718us (950us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1784584932.067149:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 52 00010000:00010000:3.0:1784584932.069506:0:3306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.069528:0:3306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.069535:0:3306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.069542:0:3306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3e00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:3.0:1784584932.069548:0:3306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.069579:0:3306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.069600:0:3306:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c636f400) 00010000:00010000:3.0:1784584932.069603:0:3306:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784584932.069608:0:3306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.069625:0:3306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa3e00/0x787d778cc3ff260d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584932.073515:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584932.073685:0:15677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549149312 00000100:00100000:0.0:1784584932.073847:0:15677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549149312 00000100:00100000:0.0:1784584932.073927:0:15677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:0.0:1784584932.073940:0:15677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:14450:x1871272549149312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784584932.073966:0:15677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784584932.073993:0:15677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe82ace8206fb3364 expref: -99 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.074050:0:15677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb335d expref: 8 pid: 14937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.074060:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584932.074065:0:15677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584932.074071:0:15677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 8 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.074113:0:15677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb335d expref: 8 pid: 14937 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.074128:0:15677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb335d expref: 8 pid: 14937 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584932.074144:0:15677:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15677:1871272569048192:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584932.074242:0:15677:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584932.079306:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584932.079394:0:14286:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549149440 00000100:00100000:2.0:1784584932.079406:0:14286:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549149440 00010000:00010000:2.0:1784584932.079460:0:14286:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb335d expref: 9 pid: 14937 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.079511:0:14286:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:2.0:1784584932.079523:0:14286:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:2355:x1871272549149440:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784584932.079541:0:14286:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784584932.079571:0:14286:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb335d expref: 9 pid: 14937 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.079588:0:14286:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb335d expref: 9 pid: 14937 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.079630:0:14286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584932.079637:0:14286:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584932.079646:0:14286:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 9 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.079682:0:14286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 9 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.079785:0:14286:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 9 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.079805:0:14286:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f400a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14286:1871272569048320:192.168.203.52@tcp:105: 00000100:00100000:2.0:1784584932.079908:0:14286:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c8015939c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784584932.081286:0:15677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090c7d747/0x787d778cc3ff2606 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb335d expref: 9 pid: 14937 timeout: 527 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584932.081315:0:15677:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5394e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15677:1871272569048192:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584932.081359:0:15677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 8 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.081398:0:15677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97c7f42bfa00, rc 0) 00000100:00100000:0.0:1784584932.081466:0:15677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c88a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+8:14450:x1871272549149312:12345-192.168.203.52@tcp:101:lhsmtool_posix.0 Request processed in 7527us (7963us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584932.081476:0:15677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:2.0:1784584932.092785:0:14286:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f400a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14286:1871272569048320:192.168.203.52@tcp:105: 00010000:00010000:2.0:1784584932.092841:0:14286:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784584932.092917:0:14286:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2355:x1871272549149440:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 13393us (13622us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584932.092929:0:14286:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:1.0:1784584932.094869:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584932.094963:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549149568 00000100:00100000:3.0:1784584932.094977:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549149568 00000100:00100000:3.0:1784584932.095051:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1784584932.095071:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2354:x1871272549149568:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784584932.095522:0:14937:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1784584932.095526:0:14937:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784584930 00002000:00010000:3.0:1784584932.095528:0:14937:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1784584929 00002000:00010000:3.0:1784584932.095530:0:14937:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784584931 -> 1784584930 00002000:00010000:3.0:1784584932.095533:0:14937:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1784584932.095606:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+8:2354:x1871272549149568:12345-192.168.203.52@tcp:2:lhsmtool_posix.0 Request processed in 544us (810us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1784584932.095628:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1784584932.102739:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584932.102836:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549149696 00000100:00100000:3.0:1784584932.102849:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549149696 00000100:00100000:3.0:1784584932.102908:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:3.0:1784584932.102918:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0736d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+8:2356:x1871272549149696:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784584932.102994:0:14936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.103019:0:14936:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 8 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.103029:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584932.103034:0:14936:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784584932.103040:0:14936:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.103096:0:14936:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 8 pid: 15677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.103111:0:14936:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 8 pid: 15677 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584932.103130:0:14936:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14936:1871272569048448:192.168.203.52@tcp:104: 00000100:00100000:3.0:1784584932.103240:0:14936:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7d2c3dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784584932.105904:0:14936:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14936:1871272569048448:192.168.203.52@tcp:104: 00010000:00010000:3.0:1784584932.105945:0:14936:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584932.112013:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584932.112119:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549149824 00000100:00100000:3.0:1784584932.112130:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549149824 00010000:00010000:3.0:1784584932.112211:0:14288:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 9 pid: 15677 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584932.112263:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1784584932.112274:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+9:2354:x1871272549149824:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584932.112413:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584932.112443:0:14288:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 9 pid: 15677 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.112459:0:14288:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 9 pid: 15677 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.112486:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b88757c/0x787d778cc3ff2614 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3364 expref: 9 pid: 15677 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.112507:0:14288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784584932.112512:0:14288:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784584932.112519:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.112531:0:14288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.112637:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584932.112763:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0736680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+8:2354:x1871272549149824:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 490us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584932.112783:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00010000:00010000:2.0:1784584932.118351:0:14936:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.118376:0:14936:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.118428:0:14936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.118438:0:14936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.118476:0:14936:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.118484:0:14936:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaece00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584932.118489:0:14936:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.118499:0:14936:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.118525:0:14936:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.118533:0:14936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f48d37a/0x787d778cc3ff261b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14936 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.118787:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0736d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2356:x1871272549149696:12345-192.168.203.52@tcp:1:lhsmtool_posix.0 Request processed in 15862us (16098us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584932.118799:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:1.0:1784584932.130758:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584932.130836:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549150080 00000100:00100000:0.0:1784584932.130849:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549150080 00000100:00100000:0.0:1784584932.130924:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 53 00000100:00100000:0.0:1784584932.130936:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+14:14450:x1871272549150080:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784584932.131068:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.131090:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.131104:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.131421:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.131435:0:14301:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb334f expref: 15 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.131445:0:14301:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.131487:0:14301:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb334f expref: 15 pid: 14301 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.131511:0:14301:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb334f expref: 15 pid: 14301 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584932.131529:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1871272569048576:192.168.203.52@tcp:104: 00000100:00100000:0.0:1784584932.131640:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584932.134552:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584932.134727:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1871272569048576:192.168.203.52@tcp:104: 00010000:00010000:0.0:1784584932.134761:0:14301:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584932.135216:0:16315:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549150208 00000100:00100000:3.0:1784584932.135225:0:16315:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549150208 00010000:00010000:3.0:1784584932.135275:0:16315:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb334f expref: 16 pid: 14301 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584932.135322:0:16315:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:3.0:1784584932.135334:0:16315:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+16:2354:x1871272549150208:12345-192.168.203.52@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784584932.135354:0:16315:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784584932.135363:0:16315:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb334f expref: 16 pid: 14301 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.135377:0:16315:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb334f expref: 16 pid: 14301 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.135405:0:16315:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7feb0fe00/0x787d778cc3ff25f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb334f expref: 16 pid: 14301 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.135423:0:16315:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c636f400) 00010000:00010000:3.0:1784584932.135430:0:16315:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.135442:0:16315:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.135451:0:16315:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.135506:0:16315:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784584932.135578:0:16315:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0736300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+15:2354:x1871272549150208:12345-192.168.203.52@tcp:103:ldlm_bl.0 Request processed in 245us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584932.135587:0:16315:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00010000:00010000:0.0:1784584932.136675:0:14301:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.136711:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784584932.136975:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1784584932.137999:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1784584932.138077:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1784584932.138198:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14301:1871272569048704:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784584932.140281:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584932.140411:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a900 going to sleep for 11 seconds 00000100:00100000:1.0:1784584932.140557:0:14306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569048704 00000100:00100000:1.0:1784584932.140569:0:14306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569048704 00000100:00100000:1.0:1784584932.140676:0:14306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784584932.140687:0:14306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14301:x1871272569048704:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784584932.140907:0:14306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14301:x1871272569048704:12345-0@lo:1000:mdt00_000.0 Request processed in 222us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584932.140916:0:14306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784584932.141223:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5394e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14301:1871272569048704:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1784584932.143942:0:14301:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1784584932.145852:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5397480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14301:1871272569048832:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1784584932.145963:0:14301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784584932.146004:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9a300 going to sleep for 11 seconds 00000100:00100000:1.0:1784584932.146247:0:14307:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569048832 00000100:00100000:1.0:1784584932.146257:0:14307:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569048832 00000100:00100000:1.0:1784584932.146318:0:14307:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784584932.146329:0:14307:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14301:x1871272569048832:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1784584932.148055:0:14307:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14301:x1871272569048832:12345-0@lo:1000:mdt00_000.0 Request processed in 1715us (2079us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1784584932.148108:0:14307:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784584932.148952:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5397480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14301:1871272569048832:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1784584932.149354:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149387:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149396:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149403:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bfa00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584932.149409:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149417:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149437:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c636f400) 00010000:00010000:0.0:1784584932.149440:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584932.149447:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149454:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfa00/0x787d778cc3ff2629 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149500:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149507:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149513:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149518:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf000 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584932.149529:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149536:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149546:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584932.149549:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784584932.149558:0:14301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff2588 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3333 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149571:0:14301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff2588 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3333 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149581:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff2588 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3333 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.149676:0:14301:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bfe00/0x787d778cc3ff2588 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.52@tcp remote: 0xe82ace8206fb3333 expref: 18 pid: 14303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584932.149933:0:14301:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5395180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1871272569048960:192.168.203.52@tcp:105: 00000100:00100000:0.0:1784584932.150049:0:14301:0:(client.c:2702:ptlrpc_set_wait()) set ffff97c7ffc9af00 going to sleep for 11 seconds 00000100:00100000:0.0:1784584932.153559:0:14301:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5395180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14301:1871272569048960:192.168.203.52@tcp:105: 00010000:00010000:0.0:1784584932.153599:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153622:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bf000/0x787d778cc3ff2581 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15235 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153682:0:14301:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153741:0:14301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153759:0:14301:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153773:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153780:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153787:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153794:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42be600 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584932.153808:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153817:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153833:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584932.153836:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784584932.153840:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153847:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42be600/0x787d778cc3ff2630 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153891:0:14301:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153898:0:14301:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153905:0:14301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153911:0:14301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bea00 already unused, calling callback (ffffffffc21bc4f0) 00010000:00010000:0.0:1784584932.153914:0:14301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153920:0:14301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153930:0:14301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97c7c636fa00) 00010000:00010000:0.0:1784584932.153933:0:14301:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784584932.153936:0:14301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.153943:0:14301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7f42bea00/0x787d778cc3ff2622 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14301 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584932.154654:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14450:x1871272549150080:12345-192.168.203.52@tcp:57:lhsmtool_posix.0 Request processed in 23714us (23903us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1784584932.154665:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 53 00000020:00080000:0.0:1784584932.154673:0:14301:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1784584932.157941:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1784584932.157955:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784584932.157993:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1784584932.158017:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784584932.158383:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584932.158520:0:14304:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549150464 00000100:00100000:2.0:1784584932.158531:0:14304:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549150464 00000100:00100000:2.0:1784584932.158601:0:14304:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 10 00000100:00100000:2.0:1784584932.158621:0:14304:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d8ba0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+18:14450:x1871272549150464:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1784584932.161792:0:14304:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1784584932.161972:0:14304:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1784584932.162078:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.162099:0:14304:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.162113:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.162124:0:14304:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.162131:0:14304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.162149:0:14304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.162181:0:14304:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784584932.162409:0:14304:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d8ba0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+20:14450:x1871272549150464:12345-192.168.203.52@tcp:35:lhsmtool_posix.0 Request processed in 3790us (4024us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1784584932.162422:0:14304:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 10 00000020:00080000:2.0:1784584932.162429:0:14304:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784584932.162880:0:14290:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784584932.162890:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.162899:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584932.162905:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.162914:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.162931:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97c7c636f400) 00010000:00010000:3.0:1784584932.162935:0:14290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784584932.162939:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.162946:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97c7c7fa2200/0x787d778cc3ff2637 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14304 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.162964:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584932.162966:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784584932.162967:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584932.164159:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584932.164503:0:14305:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549150592 00000100:00100000:2.0:1784584932.164530:0:14305:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549150592 00000100:00100000:2.0:1784584932.164595:0:14305:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:2.0:1784584932.164607:0:14305:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+20:14449:x1871272549150592:12345-192.168.203.52@tcp:49:dd.0 00000100:00100000:2.0:1784584932.164814:0:14305:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+20:14449:x1871272549150592:12345-192.168.203.52@tcp:49:dd.0 Request processed in 209us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584932.164823:0:14305:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 11 00000100:00100000:1.0:1784584932.362442:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584932.362761:0:14940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549150720 00000100:00100000:3.0:1784584932.362776:0:14940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549150720 00000100:00100000:3.0:1784584932.362881:0:14940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1784584932.362894:0:14940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2357:x1871272549150720:12345-192.168.203.52@tcp:4:dd.0 00002000:00010000:3.0:1784584932.362986:0:14940:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a5e9ae2, atime: 0x6a5e9ae1, ctime: 0x6a5e9ae2, blocks: 0x1 00010000:00010000:3.0:1784584932.362998:0:14940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.363019:0:14940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=427s v=(0 0) 00010000:00010000:3.0:1784584932.363025:0:14940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584932.363033:0:14940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.363051:0:14940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784584932.379763:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584932.379924:0:14942:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1784584932.379936:0:14942:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1784584932.380366:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584932.380535:0:14941:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1784584932.380555:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549150848 00000100:00100000:0.0:1784584932.380566:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549150848 00000100:00100000:0.0:1784584932.380631:0:14941:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1784584932.380636:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549150976 00000100:00100000:0.0:1784584932.380639:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549150976 00000100:00100000:3.0:1784584932.388498:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584932.388827:0:14941:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1784584932.388843:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549151104 00000100:00100000:1.0:1784584932.388855:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549151104 00000100:00100000:0.0:1784584932.390726:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1784584932.390750:0:16430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+11:2357:x1871272549150848:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:0.0:1784584932.390808:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.390831:0:16430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584932.390837:0:16430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584932.390844:0:16430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.390860:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584932.401201:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584932.401722:0:14941:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1784584932.401739:0:14941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1784584932.404992:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549151232 00000100:00100000:1.0:1784584932.405009:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549151232 00000100:00100000:1.0:1784584932.405214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584932.405242:0:14941:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1784584932.405249:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549151488 00000100:00100000:1.0:1784584932.405253:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549151488 00000100:00100000:3.0:1784584932.407638:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:3.0:1784584932.407663:0:16431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+14:2356:x1871272549150976:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:3.0:1784584932.407780:0:16431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.407802:0:16431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584932.407807:0:16431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584932.407817:0:16431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.407836:0:16431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.427780:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584932.428569:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:0.0:1784584932.436274:0:14941:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1784584932.437594:0:14941:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1784584932.437810:0:14941:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549151360 00000100:00100000:0.0:1784584932.437823:0:14941:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549151360 00000100:00100000:3.0:1784584932.438235:0:14942:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1784584932.438247:0:14942:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549151616 00000100:00100000:3.0:1784584932.438252:0:14942:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549151616 00000100:00100000:2.0:1784584932.442349:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1784584932.442373:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+17:2357:x1871272549151104:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1784584932.443643:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.443677:0:16432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584932.443682:0:16432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584932.443719:0:16432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.443741:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.446090:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784584932.595084:0:16430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1784584932.595098:0:16430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1784584930 -> 1784584931 00002000:00010000:0.0:1784584932.595101:0:16430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784584930 -> 1784584931 00002000:00010000:0.0:1784584932.595104:0:16430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:0.0:1784584932.595126:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.595170:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.595181:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.595189:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bea00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:0.0:1784584932.595194:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.595204:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.595231:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.595240:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006cce8086/0x787d778cc3ff2645 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784584932.595367:0:16430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+25:2357:x1871272549150848:12345-192.168.203.52@tcp:4:dd.0 Request processed in 204617us (215608us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1784584932.595380:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 1 00000100:00100000:0.0:1784584932.595428:0:16430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 4 00000100:00100000:0.0:1784584932.595443:0:16430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7c5c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+24:2356:x1871272549151232:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:0.0:1784584932.595488:0:16430:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.595509:0:16430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584932.595514:0:16430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784584932.595523:0:16430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784584932.595536:0:16430:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784584932.599784:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:2.0:1784584932.599825:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1784584932.599877:0:16431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1784584932.599900:0:16431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.599938:0:16431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.599948:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.599957:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed400 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584932.599963:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.599974:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.600003:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.600013:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002280b3b0/0x787d778cc3ff264c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.600124:0:16431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+16:2356:x1871272549150976:12345-192.168.203.52@tcp:4:dd.0 Request processed in 192462us (219750us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784584932.600136:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 2 00000100:00100000:2.0:1784584932.600181:0:16431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 5 00000100:00100000:2.0:1784584932.600197:0:16431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+15:2356:x1871272549151488:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1784584932.600241:0:16431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.600265:0:16431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584932.600270:0:16431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584932.600279:0:16431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.600293:0:16431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.602753:0:14940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.602780:0:14940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.602798:0:14940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.602807:0:14940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaed200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584932.602813:0:14940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.602824:0:14940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.602860:0:14940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.602868:0:14940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003df5b5d5/0x787d778cc3ff263e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584932.602958:0:14940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+15:2357:x1871272549150720:12345-192.168.203.52@tcp:4:dd.0 Request processed in 240062us (240525us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1784584932.602983:0:14940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 0 00000100:00100000:3.0:1784584932.603028:0:14940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 6 00000100:00100000:3.0:1784584932.603041:0:14940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+14:2356:x1871272549151360:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:3.0:1784584932.603086:0:14940:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.603101:0:14940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584932.603106:0:14940:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784584932.603113:0:14940:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.603125:0:14940:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784584932.661946:0:16432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00010000:00010000:2.0:1784584932.661975:0:16432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.661991:0:16432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.662001:0:16432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.662009:0:16432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2a00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584932.662015:0:16432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.662025:0:16432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.662052:0:16432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.662080:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007744b08c/0x787d778cc3ff2653 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.662316:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+20:2357:x1871272549151104:12345-192.168.203.52@tcp:4:dd.0 Request processed in 219943us (273825us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1784584932.662329:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 3 00000100:00100000:2.0:1784584932.662375:0:16432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 7 00000100:00100000:2.0:1784584932.662390:0:16432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+19:2356:x1871272549151616:12345-192.168.203.52@tcp:4:dd.0 00010000:00010000:2.0:1784584932.662433:0:16432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.662448:0:16432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584932.662452:0:16432:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784584932.662460:0:16432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.662474:0:16432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784584932.662860:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1784584932.714284:0:16430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1784584932.714298:0:16430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:3.0:1784584932.714316:0:16430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.714332:0:16430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.714342:0:16430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.714350:0:16430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7f42bf000 already unused, calling callback (ffffffffc177e230) 00010000:00010000:3.0:1784584932.714370:0:16430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.714382:0:16430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.714410:0:16430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784584932.714418:0:16430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000438ab1d7/0x787d778cc3ff265a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16430 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784584932.714552:0:16430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7c5c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+19:2356:x1871272549151232:12345-192.168.203.52@tcp:4:dd.0 Request processed in 119107us (313357us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1784584932.714566:0:16430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 4 00010000:00010000:2.0:1784584932.717975:0:16431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718000:0:16431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718032:0:16431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718040:0:16431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa2200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584932.718045:0:16431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718064:0:16431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718088:0:16431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718096:0:16431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b13c03d5/0x787d778cc3ff2661 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.718222:0:16431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0737480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+17:2356:x1871272549151488:12345-192.168.203.52@tcp:4:dd.0 Request processed in 118024us (313005us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784584932.718234:0:16431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 5 00010000:00010000:2.0:1784584932.718293:0:14940:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718302:0:14940:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718321:0:14940:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718327:0:14940:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7faaec200 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584932.718330:0:14940:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718337:0:14940:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718348:0:14940:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.718355:0:14940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c04ad7b0/0x787d778cc3ff2668 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.718392:0:14940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+15:2356:x1871272549151360:12345-192.168.203.52@tcp:4:dd.0 Request processed in 115355us (290625us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1784584932.718399:0:14940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 6 00000001:00080000:2.0:1784584932.718439:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:2.0:1784584932.718735:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1784584932.777079:0:16432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1784584932.777115:0:16432:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.777137:0:16432:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.777162:0:16432:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.777170:0:16432:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97c7c7fa3c00 already unused, calling callback (ffffffffc177e230) 00010000:00010000:2.0:1784584932.777176:0:16432:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.777186:0:16432:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.777209:0:16432:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784584932.777217:0:16432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000002775e2/0x787d778cc3ff266f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784584932.778124:0:16432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+7:2356:x1871272549151616:12345-192.168.203.52@tcp:4:dd.0 Request processed in 115723us (349541us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1784584932.778149:0:16432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 7 00000001:00080000:2.0:1784584932.778210:0:6631:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:2.0:1784584933.468240:0:14289:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784584934.241636:0:16473:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:1.0:1784584934.350771:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584934.350807:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584934.350827:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:3.0:1784584934.350954:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549152128 00000100:00100000:3.0:1784584934.350965:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549152128 00000100:00100000:3.0:1784584934.351028:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549152384 00000100:00100000:3.0:1784584934.351031:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549152384 00000100:00100000:3.0:1784584934.351056:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1784584934.351066:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2357:x1871272549152128:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584934.351146:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2357:x1871272549152128:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 81us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584934.351154:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 13 00000100:00100000:3.0:1784584934.351174:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00100000:3.0:1784584934.351180:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2357:x1871272549152384:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:3.0:1784584934.351220:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2357:x1871272549152384:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 40us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1784584934.351226:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 14 00000100:00080000:3.0:1784584934.351242:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584934.351246:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784584934.351464:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549151872 00000100:00100000:2.0:1784584934.351469:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549151872 00000100:00100000:2.0:1784584934.351517:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:2.0:1784584934.351524:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+20:2357:x1871272549151872:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584934.351577:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+20:2357:x1871272549151872:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 54us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584934.351584:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 28 00000100:00100000:1.0:1784584934.351794:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584934.351831:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:2.0:1784584934.351914:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549152000 00000100:00100000:2.0:1784584934.351918:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549152000 00000100:00100000:2.0:1784584934.351945:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:2.0:1784584934.351951:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2357:x1871272549152000:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584934.351984:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0735180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ef0695b2-b73d-4d2d-9d3e-86d6851e1509+5:2357:x1871272549152000:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584934.351991:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 15 00000100:00100000:1.0:1784584934.352081:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584934.352115:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.52@tcp (source: 12345-192.168.203.52@tcp) 00000100:00100000:1.0:1784584934.352135:0:14302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549152256 00000100:00100000:1.0:1784584934.352138:0:14302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549152256 00000100:00100000:1.0:1784584934.352163:0:14302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:1.0:1784584934.352169:0:14302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2357:x1871272549152256:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584934.352200:0:14302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0734700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+6:2357:x1871272549152256:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 32us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584934.352216:0:14302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 29 00000100:00100000:1.0:1784584934.352239:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549151744 00000100:00100000:1.0:1784584934.352242:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549151744 00000100:00100000:1.0:1784584934.352266:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:1.0:1784584934.352273:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7faaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:2356:x1871272549151744:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:1.0:1784584934.352299:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7faaf5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e9b2828d-82a9-4744-ba1c-9b5761f53fea+13:2356:x1871272549151744:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 26us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584934.352305:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 122 00000100:00100000:2.0:1784584934.352411:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272549152512 00000100:00100000:2.0:1784584934.352415:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272549152512 00000100:00100000:2.0:1784584934.352448:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00100000:2.0:1784584934.352454:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d0736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2357:x1871272549152512:12345-192.168.203.52@tcp:400:kworker.0 00000100:00100000:2.0:1784584934.352480:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d0736a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1721672f-5c01-4877-84ad-d16d0b74ee5d+5:2357:x1871272549152512:12345-192.168.203.52@tcp:400:kworker.0 Request processed in 27us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584934.352485:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.52@tcp, seq: 16 00000100:00080000:3.0:1784584934.352908:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784584934.352911:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584934.352914:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784584934.509998:0:14290:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784584934.941260:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569049472:0@lo:400:kworker.0 00000100:00100000:1.0:1784584934.941330:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584934.941390:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784584934.941397:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569049344:0@lo:400:kworker.0 00000100:00100000:1.0:1784584934.941424:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584934.941460:0:14303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569049472 00000100:00100000:1.0:1784584934.941467:0:14303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569049472 00000100:00100000:1.0:1784584934.941515:0:14303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784584934.941524:0:14303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569049472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584934.941573:0:14303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871272569049472:12345-0@lo:400:kworker.0 Request processed in 50us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584934.941581:0:14303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784584934.941616:0:14937:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569049344 00000100:00100000:1.0:1784584934.941620:0:14937:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569049344 00000100:00100000:1.0:1784584934.941658:0:14937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584934.941665:0:14937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569049344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584934.941719:0:14937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871272569049344:12345-0@lo:400:kworker.0 Request processed in 54us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584934.941739:0:14937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1784584934.941786:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3323:1871272569049344:0@lo:400:kworker.0 00000100:00100000:1.0:1784584934.941797:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871272569049472:0@lo:400:kworker.0 00000100:00100000:2.0:1784584934.942063:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:978ed13c-6d08-4d66-8bb5-98db460a5248:3320:1871272569049088:0@lo:400:kworker.0 00000100:00100000:2.0:1784584934.942100:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584934.942141:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569049600:0@lo:400:kworker.0 00000100:00100000:2.0:1784584934.942165:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584934.942183:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784584934.942189:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569049216:0@lo:400:kworker.0 00000100:00100000:2.0:1784584934.942209:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584934.942233:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7d022d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569049728:0@lo:400:kworker.0 00000100:00100000:2.0:1784584934.942255:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584934.942278:0:14936:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569049216 00000100:00100000:2.0:1784584934.942282:0:14936:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569049216 00000100:00100000:2.0:1784584934.942310:0:14936:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584934.942316:0:14936:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569049216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784584934.942353:0:14936:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1871272569049216:12345-0@lo:400:kworker.0 Request processed in 37us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584934.942359:0:14936:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784584934.942383:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1784584934.942388:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff97c7c5c8b100, transno 8589934595 00000004:00080000:2.0:1784584934.942397:0:3320:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1784584934.942417:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3320:1871272569049216:0@lo:400:kworker.0 00000100:00080000:3.0:1784584934.942604:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784584934.942609:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784584934.943424:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569049600 00000100:00100000:0.0:1784584934.943430:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569049600 00000100:00100000:0.0:1784584934.943469:0:14301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569049728 00000100:00100000:0.0:1784584934.943474:0:14301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569049728 00000100:00100000:0.0:1784584934.943492:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784584934.943498:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569049600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584934.943566:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f400a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871272569049600:12345-0@lo:400:kworker.0 Request processed in 68us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584934.943573:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784584934.943590:0:14301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784584934.943607:0:14301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7f4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569049728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784584934.943641:0:14301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7f4009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871272569049728:12345-0@lo:400:kworker.0 Request processed in 35us (1384us total) trans 0 rc 0/0 00000100:00100000:0.0:1784584934.943646:0:14301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784584934.943680:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3320:1871272569049728:0@lo:400:kworker.0 00000100:00100000:0.0:1784584934.943712:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3320:1871272569049600:0@lo:400:kworker.0 00000100:00100000:1.0:1784584934.943804:0:14296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569049088 00000100:00100000:1.0:1784584934.943809:0:14296:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569049088 00000100:00100000:1.0:1784584934.943855:0:14296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784584934.943863:0:14296:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d13bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3320:x1871272569049088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784584934.943905:0:14296:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d13bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:978ed13c-6d08-4d66-8bb5-98db460a5248+19:3320:x1871272569049088:12345-0@lo:400:kworker.0 Request processed in 43us (1804us total) trans 0 rc 0/0 00000100:00100000:1.0:1784584934.943911:0:14296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784584934.943961:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7d022c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:978ed13c-6d08-4d66-8bb5-98db460a5248:3320:1871272569049088:0@lo:400:kworker.0 00000100:00080000:3.0:1784584934.944553:0:14297:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784584934.944622:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7f4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569049856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584934.944662:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784584934.944727:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784584934.944733:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569049984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1784584934.944756:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784584934.951629:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569049856 00000100:00100000:2.0:1784584934.951643:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569049856 00000100:00100000:2.0:1784584934.951687:0:14939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871272569049984 00000100:00100000:2.0:1784584934.951701:0:14939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871272569049984 00000100:00100000:2.0:1784584934.951717:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584934.951726:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569049856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1784584934.951763:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784584934.951949:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569049856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 223us (7286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584934.951957:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784584934.951972:0:14939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784584934.951978:0:14939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff97c7d022df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569049984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1784584934.951996:0:14939:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1784584934.952020:0:14939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff97c7d022df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871272569049984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (7263us total) trans 0 rc 0/0 00000100:00100000:2.0:1784584934.952046:0:14939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784584934.955708:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7f4008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569049856:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1784584934.955750:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff97c7c5c8b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3322:1871272569049984:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1784584935.261016:0:14333:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784584935.261028:0:14333:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784584935.261063:0:14333:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1784584935.261076:0:14333:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1784584935.516616:0:15679:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28955 lines, 28955 kept, 0 dropped, 0 bad.